Sep 12 20:49:01 devstack cinder-volume[76660]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 12 20:49:01 devstack cinder-volume[76660]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 12 20:49:01 devstack cinder-volume[76660]: we strongly recommend against using it for new projects.
Sep 12 20:49:01 devstack cinder-volume[76660]: If you are already using Eventlet, we recommend migrating to a different
Sep 12 20:49:01 devstack cinder-volume[76660]: framework.  For more detail see
Sep 12 20:49:01 devstack cinder-volume[76660]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 12 20:49:01 devstack cinder-volume[76660]:   import eventlet  # noqa
Sep 12 20:49:04 devstack cinder-volume[76660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76660) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:49:04 devstack cinder-volume[76660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76660) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:49:04 devstack cinder-volume[76660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76660) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:49:05 devstack cinder-volume[76660]: INFO dbcounter [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Registered counter for database cinder
Sep 12 20:49:05 devstack cinder-volume[76660]: DEBUG oslo_db.sqlalchemy.engines [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:49:05 devstack cinder-volume[76660]: DEBUG dbcounter [-] [76660] Writer thread running {{(pid=76660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 12 20:49:05 devstack cinder-volume[76660]: INFO cinder.rpc [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 12 20:49:05 devstack cinder-volume[76660]: INFO cinder.rpc [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 12 20:49:05 devstack cinder-volume[76660]: DEBUG oslo_db.sqlalchemy.engines [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:49:05 devstack cinder-volume[76660]: INFO cinder.volume.manager [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Determined volume DB was empty at startup.
Sep 12 20:49:05 devstack cinder-volume[76660]: DEBUG cinder.volume.manager [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76660) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 12 20:49:05 devstack cinder-volume[76660]: INFO cinder.volume.manager [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 12 20:49:05 devstack cinder-volume[76660]: WARNING stevedore.named [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 12 20:49:05 devstack cinder-volume[76660]: WARNING castellan.key_manager [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:49:05 devstack cinder-volume[76660]: WARNING cinder.keymgr.conf_key_mgr [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG cinder.volume.drivers.lvm [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76660) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_concurrency.processutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_concurrency.processutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.414s {{(pid=76660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_db.sqlalchemy.engines [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:49:06 devstack cinder-volume[76660]: INFO cinder.rpc [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 12 20:49:06 devstack cinder-volume[76660]: INFO cinder.rpc [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 12 20:49:06 devstack cinder-volume[76660]: WARNING stevedore.named [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 12 20:49:06 devstack cinder-volume[76660]: WARNING castellan.key_manager [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:49:06 devstack cinder-volume[76660]: INFO cinder.volume.manager [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_db.sqlalchemy.engines [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:49:06 devstack cinder-volume[76660]: INFO oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Starting 1 workers
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Started child 76806 {{(pid=76660) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Full set of CONF: {{(pid=76660) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] ******************************************************************************** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Configuration options gathered from: {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] ================================================================================ {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] allow_availability_zone_fallback = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] allow_compression_on_image_upload = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] allowed_direct_url_schemes     = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] api_rate_limit                 = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] auth_strategy                  = keystone {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] az_cache_duration              = 3600 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_availability_zone      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_host                   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_name                   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_stats_polling_interval = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backup_api_class               = cinder.backup.api.API {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76806]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backup_name_template           = backup-%s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backup_use_same_host           = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backup_use_temp_snapshot       = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] chap_password                  = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] chap_username                  =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_internal_tenant_project_id = 52824f7c0fc54d698b886a07c83ba783 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_internal_tenant_user_id = c503797f7059486293ec0bee769e670c {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cloned_volume_same_az          = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cluster                        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] compression_format             = gzip {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] config_dir                     = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] config_source                  = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] control_exchange               = openstack {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] debug                          = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] default_availability_zone      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] default_group_type             = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] default_volume_type            = lvmdriver-1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] disk_geometry                  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] driver_client_cert             = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] driver_client_cert_key         = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] driver_data_namespace          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] driver_ssl_cert_path           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] driver_ssl_cert_verify         = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] driver_use_ssl                 = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] enable_force_upload            = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] enable_new_services            = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] enable_unsupported_driver      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] enforce_multipath_for_image_xfer = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] filter_function                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_api_insecure            = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_api_servers             = ['http://192.168.122.82/image'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_api_ssl_compression     = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_ca_certificates_file    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_certfile                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_keyfile                 = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_num_retries             = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance_request_timeout         = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] goodness_function              = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] graceful_shutdown_timeout      = 5 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] group_api_class                = cinder.group.api.API {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] host                           = devstack {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_compress_on_upload       = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_conversion_address_space_limit = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_conversion_cpu_limit     = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_conversion_disable       = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_upload_use_cinder_backend = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_upload_use_internal_tenant = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_volume_cache_enabled     = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_volume_cache_max_count   = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] init_host_max_objects_retrieval = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] iscsi_target_flags             =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] iscsi_write_cache              = on {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] iser_helper                    = tgtadm {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] iser_ip_address                = 192.168.122.82 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] iser_port                      = 3260 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_color                      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_config_append              = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_dir                        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_file                       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_options                    = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_rotate_interval            = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_rotate_interval_type       = days {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] log_rotation_type              = none {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] max_age                        = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] max_logfile_count              = 30 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] max_logfile_size_mb            = 200 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] max_over_subscription_ratio    = 20.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] message_reap_interval          = 86400 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] message_ttl                    = 2592000 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] monkey_patch                   = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] monkey_patch_modules           = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] my_ip                          = 192.168.122.82 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] no_snapshot_gb_quota           = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] num_iser_scan_tries            = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] num_shell_tries                = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] num_volume_device_scan_tries   = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] nvmeof_conn_info_version       = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] nvmet_ns_id                    = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] nvmet_port_id                  = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_max_limit                = 1000 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_volume_ext_list          = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_volume_listen_port       = 8776 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_volume_use_ssl           = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] osapi_volume_workers           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] per_volume_size_limit          = -1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] periodic_fuzzy_delay           = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] periodic_interval              = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] public_endpoint                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] publish_errors                 = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_backup_gigabytes         = 1000 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_backups                  = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_gigabytes                = 1000 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_groups                   = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_snapshots                = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] quota_volumes                  = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] rate_limit_burst               = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] rate_limit_except_level        = CRITICAL {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] rate_limit_interval            = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] reinit_driver_count            = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] replication_device             = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] report_discard_supported       = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] report_interval                = 120 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76806]: INFO cinder.volume.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] reservation_clean_interval     = 86400 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] reservation_expire             = 86400 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] reserved_image_namespaces      = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] reserved_percentage            = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] rpc_response_timeout           = 120 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] run_external_periodic_tasks    = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] scst_target_driver             = iscsi {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] scst_target_iqn_name           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_down_time              = 720 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] shell_completion               = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] snapshot_name_template         = snapshot-%s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] snapshot_same_host             = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] split_loggers                  = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] state_path                     = /opt/stack/data/cinder {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] storage_availability_zone      = nova {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] storage_protocol               = iSCSI {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] syslog_log_facility            = LOG_USER {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] target_helper                  = lioadm {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] target_ip_address              = 192.168.122.82 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] target_port                    = 3260 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] target_protocol                = iscsi {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] target_secondary_ip_addresses  = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] trace_flags                    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] transport_url                  = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] until_refresh                  = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_chap_auth                  = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_default_quota_class        = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_journal                    = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_json                       = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_multipath_for_image_xfer   = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_stderr                     = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] use_syslog                     = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] verify_glance_signatures       = enabled {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_api_class               = cinder.volume.api.API {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_backend_name            = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_clear                   = zero {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_clear_ionice            = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_clear_size              = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_copy_bps_limit          = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_dd_blocksize            = 1M {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_name_template           = volume-%s {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_service_inithost_offload = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volume_usage_audit_period      = month {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] zoning_mode                    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.auth_section = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.auth_type   = password {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.auth_version = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.cache       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.certfile    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.insecure    = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.interface   = public {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.keyfile     = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_password = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcache_username = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.region_name = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.service_type = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.backend                  = dogpile.cache.null {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.backend_argument         = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.backend_expiration_time  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.config_prefix            = cache.oslo {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.debug_cache_backend      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.enable_retry_client      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.enable_socket_keepalive  = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.enabled                  = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.expiration_time          = 600 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_dead_retry      = 300 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_sasl_enabled    = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.password                 = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.proxies                  = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.redis_db                 = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.redis_server             = localhost:6379 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.retry_attempts           = 2 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.retry_delay              = 0.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.socket_keepalive_count   = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.socket_keepalive_idle    = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.socket_keepalive_interval = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.socket_timeout           = 1.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.tls_allowed_ciphers      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.tls_cafile               = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.tls_certfile             = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.tls_enabled              = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.tls_keyfile              = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cache.username                 = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] coordination.backend_url       = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.asyncio_connection    = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.asyncio_slave_connection = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.backend               = sqlalchemy {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.connection            = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.connection_debug      = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.connection_parameters =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.connection_recycle_time = 3600 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.connection_trace      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.db_inc_retry_interval = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.db_max_retries        = 20 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.db_max_retry_interval = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.db_retry_interval     = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.max_overflow          = 50 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.max_pool_size         = 5 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.max_retries           = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.pool_timeout          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.retry_interval        = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.slave_connection      = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.sqlite_synchronous    = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.synchronous_reader    = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] database.use_db_reconnect      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_tracing.insecure = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.connection_string     = messaging:// {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.enabled               = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.es_doc_type           = notification {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.es_scroll_size        = 10000 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.es_scroll_time        = 2m {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.filter_error_trace    = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.hmac_keys             = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.sentinel_service_name = mymaster {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.socket_timeout        = 0.1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.trace_requests        = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler.trace_sqlalchemy      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler_jaeger.process_tags   = {} {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] profiler_otlp.service_name_prefix = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.policy_default_rule = default {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.group          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.helper_command = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] privsep_osbrick.user           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.group         = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.helper_command = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] cinder_sys_admin.user          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.auth_section      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.auth_type         = password {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.cafile            = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.certfile          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.collect_timing    = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.insecure          = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.keyfile           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.send_service_user_token = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.split_loggers     = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.timeout           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.tls_ciphers       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] service_user.tls_min_version   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.auth_section            = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.auth_type               = password {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.certfile                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.collect_timing          = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.insecure                = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.keyfile                 = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.region_name             = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.split_loggers           = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.timeout                 = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.tls_ciphers             = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] glance.tls_min_version         = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.backend_availability_zone = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.chap_password = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.chap_username =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.disk_geometry = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.driver_client_cert = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.driver_data_namespace = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.driver_use_ssl = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.extra_capabilities = {} {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.filter_function = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.goodness_function = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.iscsi_target_flags =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.iser_port     = 3260 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.lvm_share_target = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.lvm_type      = auto {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.replication_device = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.report_discard_supported = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack sudo[76811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.target_helper = tgtadm {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.target_port   = 3260 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.target_protocol = iscsi {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.trace_flags   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.use_chap_auth = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_backend_name = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_clear  = zero {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_reports.file_event_handler = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_reports.log_dir           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.backend_host       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.chap_password      = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.chap_username      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.disk_geometry      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.driver_client_cert = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.extra_capabilities = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.filter_function    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.goodness_function  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.iser_helper        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.iser_port          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.lvm_type           = auto {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.replication_device = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.report_discard_supported = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.reserved_percentage = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.scst_target_driver = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.storage_protocol   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.target_ip_address  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.target_port        = 3260 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.trace_flags        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_clear       = zero {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] lvmdriver-1.volumes_dir        = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_notifications.driver = [] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] key_manager.fixed_key          = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.barbican_api_version  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.barbican_endpoint     = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.barbican_endpoint_type = public {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.barbican_region_name  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.cafile                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.certfile              = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.collect_timing        = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.insecure              = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.keyfile               = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.number_of_retries     = 60 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.retry_delay           = 1 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.send_service_user_token = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.split_loggers         = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.timeout               = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.tls_ciphers           = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.tls_min_version       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.verify_ssl            = True {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican.verify_ssl_path       = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.auth_section = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.auth_type = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.cafile   = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.certfile = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.collect_timing = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.insecure = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.keyfile  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.split_loggers = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.timeout  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.tls_ciphers = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] barbican_service_user.tls_min_version = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.approle_role_id          = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.approle_secret_id        = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.auth_method              = approle {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.auth_path                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.kv_mountpoint            = secret {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.kv_path                  = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.kv_version               = 2 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.namespace                = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.root_token_id            = **** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.ssl_ca_crt_file          = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.timeout                  = 60.0 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.token_file               = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.token_role               = None {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.use_ssl                  = False {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:49:06 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] ******************************************************************************** {{(pid=76660) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 12 20:49:07 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.376s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:07 devstack sudo[76815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:07 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:07 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.308s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 20:49:07 devstack cinder-volume[76806]: INFO cinder.brick.local_dev.lvm [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:07 devstack sudo[76860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:49:07 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:07 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG cinder.brick.local_dev.lvm [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76806) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 12 20:49:07 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:07 devstack sudo[76985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:07 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:08 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:08 devstack sudo[77181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:08 devstack sudo[77181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:08 devstack sudo[77181]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:08 devstack sudo[77274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 12 20:49:08 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:08 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:08 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:08 devstack sudo[77349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:49:08 devstack sudo[77349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:09 devstack sudo[77349]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:09 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:09 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:09 devstack sudo[77429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:49:09 devstack sudo[77429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:09 devstack sudo[77429]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:09 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:09 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:09 devstack sudo[77432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:09 devstack sudo[77432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:09 devstack sudo[77432]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:09 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.352s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:09 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:09 devstack sudo[77516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:09 devstack sudo[77516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:10 devstack sudo[77516]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:10 devstack sudo[77526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:10 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:10 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:10 devstack cinder-volume[76806]: INFO cinder.volume.drivers.lvm [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:10 devstack sudo[77610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:10 devstack sudo[77610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:10 devstack sudo[77610]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG cinder.volume.drivers.lvm [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Updating volume stats {{(pid=76806) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:10 devstack sudo[77614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:49:10 devstack sudo[77614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:10 devstack sudo[77614]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:10 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:11 devstack sudo[77623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:11 devstack sudo[77623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:11 devstack sudo[77623]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:11 devstack sudo[77626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:11 devstack sudo[77626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:11 devstack sudo[77626]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:11 devstack sudo[77629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:11 devstack sudo[77629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:11 devstack sudo[77629]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:11 devstack cinder-volume[76806]: INFO cinder.volume.driver [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Driver hasn't implemented _init_vendor_properties()
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG cinder.volume.driver [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76806) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_db.sqlalchemy.engines [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG dbcounter [-] [76806] Writer thread running {{(pid=76806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG cinder.db.sqlalchemy.api [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Building query based on filter {{(pid=76806) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG cinder.image.image_utils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76806) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Sep 12 20:49:11 devstack cinder-volume[76806]: INFO cinder.keymgr.migration [None req-7ab1e1d6-4608-4f51-8a19-52418555d9bc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG cinder.volume.drivers.lvm [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Updating volume stats {{(pid=76806) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Sep 12 20:49:11 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:11 devstack sudo[77633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:49:11 devstack sudo[77633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:12 devstack sudo[77633]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:12 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:12 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:12 devstack sudo[77636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:12 devstack sudo[77636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:12 devstack sudo[77636]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:12 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:12 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:12 devstack sudo[77640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:12 devstack sudo[77640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:12 devstack sudo[77640]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:12 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:12 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:12 devstack sudo[77644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:12 devstack sudo[77644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:13 devstack sudo[77644]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG cinder.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Notifying Schedulers of capabilities ... {{(pid=76806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:49:13 devstack cinder-volume[76806]: INFO cinder.volume.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Driver initialization completed successfully.
Sep 12 20:49:13 devstack cinder-volume[76806]: INFO cinder.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Initiating service 2 cleanup
Sep 12 20:49:13 devstack cinder-volume[76806]: INFO cinder.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Service 2 cleanup completed.
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG cinder.service [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Creating RPC server for service cinder-volume {{(pid=76806) start /opt/stack/cinder/cinder/service.py:231}}
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG cinder.service [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76806) start /opt/stack/cinder/cinder/service.py:237}}
Sep 12 20:49:13 devstack cinder-volume[76806]: INFO cinder.volume.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG cinder.volume.drivers.lvm [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Updating volume stats {{(pid=76806) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:13 devstack sudo[77648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:49:13 devstack sudo[77648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:13 devstack sudo[77648]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:13 devstack sudo[77653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:13 devstack sudo[77653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:13 devstack sudo[77653]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:13 devstack sudo[77656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:49:13 devstack sudo[77656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:13 devstack sudo[77656]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:13 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:49:14 devstack sudo[77659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:49:14 devstack sudo[77659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:49:14 devstack sudo[77659]: pam_unix(sudo:session): session closed for user root
Sep 12 20:49:14 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:49:14 devstack cinder-volume[76806]: INFO cinder.volume.manager [None req-9307ca9f-518c-4999-b668-723c0f8e4830 None None] Driver post RPC initialization completed successfully.
Sep 12 20:49:16 devstack cinder-volume[76660]: DEBUG dbcounter [-] [76660] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:49:24 devstack cinder-volume[76806]: DEBUG dbcounter [-] [76806] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:49:24 devstack cinder-volume[76806]: DEBUG dbcounter [-] [76806] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG oslo_service.periodic_task [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG cinder.volume.drivers.lvm [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Updating volume stats {{(pid=76806) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:50:34 devstack sudo[80294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:50:34 devstack sudo[80294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:50:34 devstack sudo[80294]: pam_unix(sudo:session): session closed for user root
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:50:34 devstack sudo[80297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:50:34 devstack sudo[80297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:50:34 devstack sudo[80297]: pam_unix(sudo:session): session closed for user root
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:50:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:50:34 devstack sudo[80300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:50:34 devstack sudo[80300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:50:35 devstack sudo[80300]: pam_unix(sudo:session): session closed for user root
Sep 12 20:50:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:50:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:50:35 devstack sudo[80303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:50:35 devstack sudo[80303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:50:35 devstack sudo[80303]: pam_unix(sudo:session): session closed for user root
Sep 12 20:50:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:50:35 devstack cinder-volume[76806]: DEBUG cinder.manager [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Notifying Schedulers of capabilities ... {{(pid=76806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:51:24 devstack cinder-volume[76806]: DEBUG dbcounter [-] [76806] Writing DB stats cinder:SELECT=1 {{(pid=76806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:51:24 devstack cinder-volume[76806]: DEBUG dbcounter [-] [76806] Writing DB stats cinder:UPDATE=1 {{(pid=76806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG oslo_service.periodic_task [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG cinder.volume.drivers.lvm [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Updating volume stats {{(pid=76806) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:51:34 devstack sudo[83532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:51:34 devstack sudo[83532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:51:34 devstack sudo[83532]: pam_unix(sudo:session): session closed for user root
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:51:34 devstack sudo[83551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:51:34 devstack sudo[83551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:51:34 devstack sudo[83551]: pam_unix(sudo:session): session closed for user root
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:51:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:51:34 devstack sudo[83554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:51:34 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:51:35 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root
Sep 12 20:51:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:51:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:51:35 devstack sudo[83559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:51:35 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:51:35 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root
Sep 12 20:51:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:51:35 devstack cinder-volume[76806]: DEBUG cinder.manager [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Notifying Schedulers of capabilities ... {{(pid=76806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG oslo_service.periodic_task [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG cinder.volume.drivers.lvm [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Updating volume stats {{(pid=76806) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:52:34 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 12 20:52:34 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:52:34 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:52:34 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:52:34 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:52:34 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:52:34 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:52:34 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 12 20:52:34 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:52:35 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Sep 12 20:52:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:52:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:52:35 devstack sudo[85651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 12 20:52:35 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:52:35 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root
Sep 12 20:52:35 devstack cinder-volume[76806]: DEBUG oslo_concurrency.processutils [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:52:35 devstack cinder-volume[76806]: DEBUG cinder.manager [None req-c2558381-7947-4776-b80c-5777912d1f5b None None] Notifying Schedulers of capabilities ... {{(pid=76806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:53:24 devstack cinder-volume[76806]: DEBUG dbcounter [-] [76806] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:53:30 devstack cinder-volume[76660]: INFO oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Caught SIGTERM, stopping children
Sep 12 20:53:30 devstack cinder-volume[76660]: DEBUG oslo_concurrency.lockutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Acquiring lock "singleton_lock" {{(pid=76660) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:53:30 devstack cinder-volume[76660]: DEBUG oslo_concurrency.lockutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Acquired lock "singleton_lock" {{(pid=76660) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:53:30 devstack cinder-volume[76660]: DEBUG oslo_concurrency.lockutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Releasing lock "singleton_lock" {{(pid=76660) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:53:30 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Stop services. {{(pid=76660) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 12 20:53:30 devstack cinder-volume[76660]: DEBUG oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Killing children. {{(pid=76660) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 12 20:53:30 devstack cinder-volume[76660]: INFO oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Waiting on 1 children to exit
Sep 12 20:53:33 devstack cinder-volume[76806]: DEBUG oslo_concurrency.lockutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Acquiring lock "singleton_lock" {{(pid=76806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:53:33 devstack cinder-volume[76806]: DEBUG oslo_concurrency.lockutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Acquired lock "singleton_lock" {{(pid=76806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:53:33 devstack cinder-volume[76806]: DEBUG oslo_concurrency.lockutils [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Releasing lock "singleton_lock" {{(pid=76806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:53:33 devstack cinder-volume[76806]: WARNING amqp [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 12 20:53:33 devstack cinder-volume[76806]: WARNING amqp [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 12 20:53:33 devstack cinder-volume[76660]: INFO oslo_service.backend._eventlet.service [None req-9d8006f4-1177-400c-bd63-3fee3aa131c1 None None] Child 76806 exited with status 0
Sep 12 20:53:33 devstack cinder-volume[86791]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 12 20:53:33 devstack cinder-volume[86791]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 12 20:53:33 devstack cinder-volume[86791]: we strongly recommend against using it for new projects.
Sep 12 20:53:33 devstack cinder-volume[86791]: If you are already using Eventlet, we recommend migrating to a different
Sep 12 20:53:33 devstack cinder-volume[86791]: framework.  For more detail see
Sep 12 20:53:33 devstack cinder-volume[86791]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 12 20:53:33 devstack cinder-volume[86791]:   import eventlet  # noqa
Sep 12 20:53:35 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:53:35 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:53:35 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:53:36 devstack cinder-volume[86791]: INFO dbcounter [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Registered counter for database cinder
Sep 12 20:53:36 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:36 devstack cinder-volume[86791]: DEBUG dbcounter [-] [86791] Writer thread running {{(pid=86791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 12 20:53:36 devstack cinder-volume[86791]: INFO cinder.rpc [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 12 20:53:36 devstack cinder-volume[86791]: INFO cinder.rpc [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 12 20:53:36 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:36 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Determined volume DB was empty at startup.
Sep 12 20:53:36 devstack cinder-volume[86791]: DEBUG cinder.volume.manager [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86791) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 12 20:53:36 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 12 20:53:36 devstack cinder-volume[86791]: WARNING stevedore.named [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 12 20:53:36 devstack cinder-volume[86791]: WARNING castellan.key_manager [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:53:36 devstack cinder-volume[86791]: WARNING cinder.keymgr.conf_key_mgr [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:53:36 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:37 devstack cinder-volume[86791]: INFO oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Starting 1 workers
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Started child 87007 {{(pid=86791) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Full set of CONF: {{(pid=86791) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] ******************************************************************************** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Configuration options gathered from: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 12 20:53:37 devstack cinder-volume[87007]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] ================================================================================ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] allow_availability_zone_fallback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] allow_compression_on_image_upload = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] allowed_direct_url_schemes     = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] api_rate_limit                 = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] auth_strategy                  = keystone {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_availability_zone      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_host                   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_name                   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_stats_polling_interval = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backup_api_class               = cinder.backup.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backup_name_template           = backup-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backup_use_same_host           = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backup_use_temp_snapshot       = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] chap_password                  = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] chap_username                  =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_internal_tenant_project_id = 52824f7c0fc54d698b886a07c83ba783 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_internal_tenant_user_id = c503797f7059486293ec0bee769e670c {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cluster                        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] compression_format             = gzip {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] config_dir                     = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] config_source                  = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] control_exchange               = openstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] debug                          = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] default_availability_zone      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] default_group_type             = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] default_volume_type            = QuobyteHD {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] disk_geometry                  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] driver_client_cert             = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] driver_client_cert_key         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] driver_data_namespace          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] driver_ssl_cert_path           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] driver_ssl_cert_verify         = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] driver_use_ssl                 = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] enable_new_services            = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] enable_unsupported_driver      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] enforce_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] filter_function                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_api_insecure            = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_api_servers             = ['http://192.168.122.82/image'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_api_ssl_compression     = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_ca_certificates_file    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_certfile                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_keyfile                 = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_num_retries             = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance_request_timeout         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] goodness_function              = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] graceful_shutdown_timeout      = 5 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] group_api_class                = cinder.group.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] host                           = devstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_compress_on_upload       = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_conversion_address_space_limit = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_conversion_cpu_limit     = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_conversion_disable       = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_upload_use_cinder_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_upload_use_internal_tenant = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_volume_cache_enabled     = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_volume_cache_max_count   = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] image_volume_cache_max_size_gb = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] init_host_max_objects_retrieval = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] iscsi_target_flags             =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] iscsi_write_cache              = on {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] iser_helper                    = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] iser_ip_address                = 192.168.122.82 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] iser_port                      = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_color                      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_config_append              = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_dir                        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_file                       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_options                    = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_rotate_interval            = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_rotate_interval_type       = days {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Starting volume driver QuobyteDriver (1.1.14)
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.remotefs [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87007) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] log_rotation_type              = none {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] max_age                        = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] max_logfile_count              = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] max_logfile_size_mb            = 200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] max_over_subscription_ratio    = 20.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] message_reap_interval          = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] message_ttl                    = 2592000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] migration_create_volume_timeout_secs = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] monkey_patch                   = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] monkey_patch_modules           = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] my_ip                          = 192.168.122.82 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] no_snapshot_gb_quota           = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] num_iser_scan_tries            = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] num_shell_tries                = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] num_volume_device_scan_tries   = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] nvmeof_conn_info_version       = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] nvmet_ns_id                    = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] nvmet_port_id                  = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_max_limit                = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_volume_ext_list          = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_volume_listen_port       = 8776 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_volume_use_ssl           = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] osapi_volume_workers           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] per_volume_size_limit          = -1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] periodic_fuzzy_delay           = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] periodic_interval              = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] public_endpoint                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] publish_errors                 = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_backup_gigabytes         = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_backups                  = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_gigabytes                = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_groups                   = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_snapshots                = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] quota_volumes                  = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] rate_limit_burst               = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] rate_limit_except_level        = CRITICAL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] rate_limit_interval            = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] reinit_driver_count            = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] replication_device             = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] report_discard_supported       = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] report_interval                = 120 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] reservation_clean_interval     = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] reservation_expire             = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] reserved_image_namespaces      = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] reserved_percentage            = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] rpc_response_timeout           = 120 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] run_external_periodic_tasks    = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] scst_target_driver             = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] scst_target_iqn_name           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_down_time              = 720 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] shell_completion               = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] snapshot_name_template         = snapshot-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] split_loggers                  = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] state_path                     = /opt/stack/data/cinder {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] storage_availability_zone      = nova {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] storage_protocol               = iSCSI {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] syslog_log_facility            = LOG_USER {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] target_helper                  = lioadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] target_ip_address              = 192.168.122.82 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] target_port                    = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] target_protocol                = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] target_secondary_ip_addresses  = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] trace_flags                    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] transport_url                  = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] until_refresh                  = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_chap_auth                  = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_default_quota_class        = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_journal                    = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_json                       = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_multipath_for_image_xfer   = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_stderr                     = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] use_syslog                     = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] verify_glance_signatures       = enabled {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_api_class               = cinder.volume.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_backend_name            = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_clear                   = zero {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_clear_ionice            = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_clear_size              = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_copy_bps_limit          = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_dd_blocksize            = 1M {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_name_template           = volume-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_service_inithost_offload = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volume_usage_audit_period      = month {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] zoning_mode                    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_concurrency.disable_process_locking = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.auth_type   = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.auth_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.cache       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.certfile    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.include_service_catalog = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.insecure    = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.interface   = public {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.keyfile     = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcache_username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.service_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.backend                  = dogpile.cache.null {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.backend_argument         = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.backend_expiration_time  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.config_prefix            = cache.oslo {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.debug_cache_backend      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.enable_retry_client      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.enable_socket_keepalive  = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.enabled                  = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.expiration_time          = 600 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.hashclient_retry_attempts = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_dead_retry      = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_sasl_enabled    = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.password                 = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.proxies                  = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.redis_db                 = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.redis_server             = localhost:6379 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.retry_attempts           = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.retry_delay              = 0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.socket_keepalive_count   = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.socket_keepalive_idle    = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.socket_keepalive_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.socket_timeout           = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.tls_allowed_ciphers      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.tls_cafile               = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.tls_certfile             = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.tls_enabled              = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.tls_keyfile              = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cache.username                 = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] coordination.backend_url       = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.asyncio_connection    = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.asyncio_slave_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.backend               = sqlalchemy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.connection            = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.connection_debug      = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.connection_parameters =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.connection_recycle_time = 3600 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.connection_trace      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.db_inc_retry_interval = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.db_max_retries        = 20 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.db_max_retry_interval = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.db_retry_interval     = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.max_overflow          = 50 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.max_pool_size         = 5 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.max_retries           = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.mysql_wsrep_sync_wait = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.pool_timeout          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.retry_interval        = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.slave_connection      = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.sqlite_synchronous    = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.synchronous_reader    = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] database.use_db_reconnect      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_tracing.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.connection_string     = messaging:// {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.enabled               = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.es_doc_type           = notification {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.es_scroll_size        = 10000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.es_scroll_time        = 2m {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.filter_error_trace    = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.hmac_keys             = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.sentinel_service_name = mymaster {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.socket_timeout        = 0.1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.trace_requests        = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler.trace_sqlalchemy      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler_jaeger.process_tags   = {} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87007) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Sep 12 20:53:37 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 12 20:53:37 devstack cinder-volume[87007]: WARNING cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Running cmd (subprocess): mount.quobyte {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler_jaeger.service_name_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] profiler_otlp.service_name_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.enforce_new_defaults = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.policy_default_rule = default {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.group          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.helper_command = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] privsep_osbrick.user           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.group         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.helper_command = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] cinder_sys_admin.user          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.auth_section      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.auth_type         = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.cafile            = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.certfile          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.collect_timing    = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.insecure          = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.keyfile           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.send_service_user_token = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.split_loggers     = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.timeout           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.tls_ciphers       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] service_user.tls_min_version   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.auth_section            = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.auth_type               = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.certfile                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.collect_timing          = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.insecure                = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.keyfile                 = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.region_name             = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.split_loggers           = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.timeout                 = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.tls_ciphers             = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] glance.tls_min_version         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.chap_username =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.driver_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.extra_capabilities = {} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.iscsi_target_flags =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.iscsi_write_cache = on {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.iser_port     = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_host      =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_login     = admin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_mount_options = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_password  = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_private_key =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_share_path =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.num_shell_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.quobyte_volume_url = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.report_discard_supported = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.reserved_percentage = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.target_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.target_port   = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.target_protocol = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.trace_flags   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.unique_fqdn_network = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.use_chap_auth = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_clear  = zero {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_clear_size = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_reports.file_event_handler = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_reports.log_dir           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.backend_host         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.chap_password        = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.chap_username        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.disk_geometry        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.driver_client_cert   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.extra_capabilities   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.filter_function      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.goodness_function    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.iser_helper          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.iser_ip_address      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.iser_port            = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_host             = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_login            = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_mount_options    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_password         = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_private_key      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_share_path       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.num_shell_tries      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.replication_device   = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.report_discard_supported = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.reserved_percentage  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.scst_target_driver   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.storage_protocol     = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.target_helper        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.target_ip_address    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.target_port          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.target_prefix        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.target_protocol      = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.trace_flags          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.use_chap_auth        = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_clear         = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_clear_size    = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] QuobyteHD.volumes_dir          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_notifications.driver = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_notifications.retry = -1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] key_manager.fixed_key          = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.barbican_api_version  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.barbican_endpoint     = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.barbican_endpoint_type = public {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.barbican_region_name  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.cafile                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.certfile              = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.collect_timing        = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.insecure              = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.keyfile               = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.number_of_retries     = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.retry_delay           = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.send_service_user_token = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.split_loggers         = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.timeout               = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.tls_ciphers           = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.tls_min_version       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.verify_ssl            = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican.verify_ssl_path       = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.auth_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.cafile   = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack quobyte-client[87012]: Reading configuration file: /etc/quobyte/client.cfg
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.keyfile  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.timeout  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] barbican_service_user.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.approle_role_id          = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack quobyte-client[87012]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.approle_secret_id        = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.auth_method              = approle {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.auth_path                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.kv_mountpoint            = secret {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.kv_path                  = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.kv_version               = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.namespace                = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.root_token_id            = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.ssl_ca_crt_file          = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.timeout                  = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.token_file               = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.token_role               = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.use_ssl                  = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:37 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] ******************************************************************************** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 12 20:53:37 devstack cinder-volume[87007]: INFO cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 ...
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf -c /etc/quobyte/client-cinder.cfg {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:37 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf -c /etc/quobyte/client-cinder.cfg
Sep 12 20:53:37 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:37 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.395s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:37 devstack cinder-volume[87007]: INFO cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 succeeded
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.406s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:37 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:37 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:37 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:38 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.263s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.volume.driver [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Driver hasn't implemented _init_vendor_properties()
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.volume.driver [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1777687072754, 'free_capacity_gb': 1773.1777687072754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87007) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_db.sqlalchemy.engines [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG dbcounter [-] [87007] Writer thread running {{(pid=87007) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.db.sqlalchemy.api [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Building query based on filter {{(pid=87007) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.image.image_utils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87007) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.keymgr.migration [None req-90800d26-a0f1-407e-829d-24b57a0b6cdf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:38 devstack sudo[87085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:38 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:38 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.234s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Driver initialization completed successfully.
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Initiating service 3 cleanup
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Service 3 cleanup completed.
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.service [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Creating RPC server for service cinder-volume {{(pid=87007) start /opt/stack/cinder/cinder/service.py:231}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.service [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87007) start /opt/stack/cinder/cinder/service.py:237}}
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:38 devstack sudo[87088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:38 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:38 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:38 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.252s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:38 devstack cinder-volume[87007]: INFO cinder.volume.manager [None req-ec9cb49f-7429-45b6-b4c1-c5a782a7d64a None None] Driver post RPC initialization completed successfully.
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87007) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG cinder.volume.drivers.quobyte [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87007) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87007) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:43 devstack sudo[87236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:43 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:43 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG oslo_concurrency.processutils [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.240s {{(pid=87007) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:43 devstack cinder-volume[87007]: DEBUG cinder.manager [None req-b8bdba57-6147-4ad3-97cd-34fbcffae387 None None] Notifying Schedulers of capabilities ... {{(pid=87007) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:53:44 devstack cinder-volume[86791]: INFO oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Caught SIGTERM, stopping children
Sep 12 20:53:44 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Acquiring lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:53:44 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Acquired lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:53:44 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Releasing lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:53:44 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Stop services. {{(pid=86791) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 12 20:53:44 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Killing children. {{(pid=86791) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 12 20:53:44 devstack cinder-volume[86791]: INFO oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Waiting on 1 children to exit
Sep 12 20:53:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Acquiring lock "singleton_lock" {{(pid=87007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:53:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Acquired lock "singleton_lock" {{(pid=87007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:53:46 devstack cinder-volume[87007]: DEBUG oslo_concurrency.lockutils [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Releasing lock "singleton_lock" {{(pid=87007) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:53:46 devstack cinder-volume[87007]: WARNING amqp [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 12 20:53:46 devstack cinder-volume[87007]: WARNING amqp [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 12 20:53:46 devstack cinder-volume[86791]: INFO oslo_service.backend._eventlet.service [None req-b1cebf4f-cb4c-42f1-955c-dd60a642ab89 None None] Child 87007 exited with status 0
Sep 12 20:53:47 devstack cinder-volume[87287]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 12 20:53:47 devstack cinder-volume[87287]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 12 20:53:47 devstack cinder-volume[87287]: we strongly recommend against using it for new projects.
Sep 12 20:53:47 devstack cinder-volume[87287]: If you are already using Eventlet, we recommend migrating to a different
Sep 12 20:53:47 devstack cinder-volume[87287]: framework.  For more detail see
Sep 12 20:53:47 devstack cinder-volume[87287]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 12 20:53:47 devstack cinder-volume[87287]:   import eventlet  # noqa
Sep 12 20:53:50 devstack cinder-volume[87287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 12 20:53:50 devstack cinder-volume[87287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 12 20:53:50 devstack cinder-volume[87287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 12 20:53:51 devstack cinder-volume[87287]: INFO dbcounter [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Registered counter for database cinder
Sep 12 20:53:51 devstack cinder-volume[87287]: DEBUG oslo_db.sqlalchemy.engines [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:51 devstack cinder-volume[87287]: DEBUG dbcounter [-] [87287] Writer thread running {{(pid=87287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 12 20:53:51 devstack cinder-volume[87287]: INFO cinder.rpc [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 12 20:53:51 devstack cinder-volume[87287]: INFO cinder.rpc [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 12 20:53:51 devstack cinder-volume[87287]: DEBUG oslo_db.sqlalchemy.engines [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:51 devstack cinder-volume[87287]: INFO cinder.volume.manager [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Determined volume DB was empty at startup.
Sep 12 20:53:51 devstack cinder-volume[87287]: DEBUG cinder.volume.manager [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87287) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 12 20:53:51 devstack cinder-volume[87287]: WARNING stevedore.named [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 12 20:53:51 devstack cinder-volume[87287]: WARNING castellan.key_manager [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:53:51 devstack cinder-volume[87287]: WARNING cinder.keymgr.conf_key_mgr [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 12 20:53:51 devstack cinder-volume[87287]: INFO cinder.volume.manager [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_db.sqlalchemy.engines [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:52 devstack cinder-volume[87287]: INFO oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Starting 1 workers
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Started child 87624 {{(pid=87287) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Full set of CONF: {{(pid=87287) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] ******************************************************************************** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] Configuration options gathered from: {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] ================================================================================ {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] allow_availability_zone_fallback = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] allow_compression_on_image_upload = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] allowed_direct_url_schemes     = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] api_rate_limit                 = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] auth_strategy                  = keystone {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_availability_zone      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_host                   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_name                   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_stats_polling_interval = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backup_api_class               = cinder.backup.api.API {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backup_name_template           = backup-%s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backup_use_same_host           = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backup_use_temp_snapshot       = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] chap_password                  = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] chap_username                  =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_internal_tenant_project_id = 52824f7c0fc54d698b886a07c83ba783 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_internal_tenant_user_id = c503797f7059486293ec0bee769e670c {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cluster                        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] compression_format             = gzip {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] config_dir                     = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] config_source                  = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] control_exchange               = openstack {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] debug                          = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] default_availability_zone      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] default_group_type             = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] default_volume_type            = QuobyteHD {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] disk_geometry                  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] driver_client_cert             = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] driver_client_cert_key         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] driver_data_namespace          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] driver_ssl_cert_path           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] driver_ssl_cert_verify         = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] driver_use_ssl                 = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] enable_new_services            = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] enable_unsupported_driver      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] enforce_multipath_for_image_xfer = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] filter_function                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_api_insecure            = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_api_servers             = ['http://192.168.122.82/image'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_api_ssl_compression     = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_ca_certificates_file    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_certfile                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_keyfile                 = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_num_retries             = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance_request_timeout         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] goodness_function              = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] graceful_shutdown_timeout      = 5 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] group_api_class                = cinder.group.api.API {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] host                           = devstack {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_compress_on_upload       = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_conversion_address_space_limit = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_conversion_cpu_limit     = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_conversion_disable       = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_upload_use_cinder_backend = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_upload_use_internal_tenant = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_volume_cache_enabled     = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_volume_cache_max_count   = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] init_host_max_objects_retrieval = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] iscsi_target_flags             =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] iscsi_write_cache              = on {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] iser_helper                    = tgtadm {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] iser_ip_address                = 192.168.122.82 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] iser_port                      = 3260 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_color                      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_config_append              = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_dir                        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_file                       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_options                    = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_rotate_interval            = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_rotate_interval_type       = days {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] log_rotation_type              = none {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] max_age                        = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] max_logfile_count              = 30 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] max_logfile_size_mb            = 200 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] max_over_subscription_ratio    = 20.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] message_reap_interval          = 86400 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] message_ttl                    = 2592000 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] monkey_patch                   = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] monkey_patch_modules           = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] my_ip                          = 192.168.122.82 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] no_snapshot_gb_quota           = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] num_iser_scan_tries            = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] num_shell_tries                = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] num_volume_device_scan_tries   = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] nvmeof_conn_info_version       = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] nvmet_ns_id                    = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] nvmet_port_id                  = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_max_limit                = 1000 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_volume_ext_list          = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_volume_listen_port       = 8776 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_volume_use_ssl           = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] osapi_volume_workers           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] per_volume_size_limit          = -1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] periodic_fuzzy_delay           = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] periodic_interval              = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] public_endpoint                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] publish_errors                 = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_backup_gigabytes         = 1000 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_backups                  = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_gigabytes                = 1000 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_groups                   = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_snapshots                = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] quota_volumes                  = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] rate_limit_burst               = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] rate_limit_except_level        = CRITICAL {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] rate_limit_interval            = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] reinit_driver_count            = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] replication_device             = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] report_discard_supported       = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] report_interval                = 120 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] reservation_clean_interval     = 86400 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] reservation_expire             = 86400 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] reserved_image_namespaces      = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] reserved_percentage            = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] rpc_response_timeout           = 120 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] run_external_periodic_tasks    = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] scst_target_driver             = iscsi {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] scst_target_iqn_name           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_down_time              = 720 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] shell_completion               = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] snapshot_name_template         = snapshot-%s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] split_loggers                  = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] state_path                     = /opt/stack/data/cinder {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] storage_availability_zone      = nova {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] storage_protocol               = iSCSI {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] syslog_log_facility            = LOG_USER {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] target_helper                  = lioadm {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] target_ip_address              = 192.168.122.82 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] target_port                    = 3260 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] target_protocol                = iscsi {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] target_secondary_ip_addresses  = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] trace_flags                    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] transport_url                  = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] until_refresh                  = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_chap_auth                  = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_default_quota_class        = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_journal                    = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_json                       = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_multipath_for_image_xfer   = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_stderr                     = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] use_syslog                     = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] verify_glance_signatures       = enabled {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_api_class               = cinder.volume.api.API {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_backend_name            = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_clear                   = zero {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_clear_ionice            = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_clear_size              = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_copy_bps_limit          = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_dd_blocksize            = 1M {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_name_template           = volume-%s {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_service_inithost_offload = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volume_usage_audit_period      = month {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] zoning_mode                    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.auth_section = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.auth_type   = password {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.auth_version = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.cache       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.certfile    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Starting volume driver QuobyteDriver (1.1.14)
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.insecure    = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.interface   = public {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.keyfile     = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_password = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87624) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcache_username = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.region_name = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.service_type = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.backend                  = dogpile.cache.null {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.backend_argument         = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.backend_expiration_time  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.config_prefix            = cache.oslo {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.debug_cache_backend      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.enable_retry_client      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.enable_socket_keepalive  = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.enabled                  = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.expiration_time          = 600 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_dead_retry      = 300 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_sasl_enabled    = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.password                 = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.proxies                  = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.redis_db                 = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.redis_server             = localhost:6379 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.retry_attempts           = 2 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.retry_delay              = 0.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.socket_keepalive_count   = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.socket_keepalive_idle    = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.socket_keepalive_interval = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.socket_timeout           = 1.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.tls_allowed_ciphers      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.tls_cafile               = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.tls_certfile             = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.tls_enabled              = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.tls_keyfile              = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cache.username                 = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] coordination.backend_url       = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.asyncio_connection    = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.asyncio_slave_connection = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.backend               = sqlalchemy {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.connection            = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.connection_debug      = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.connection_parameters =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.connection_recycle_time = 3600 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.connection_trace      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.db_inc_retry_interval = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.db_max_retries        = 20 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.db_max_retry_interval = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.db_retry_interval     = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.max_overflow          = 50 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.max_pool_size         = 5 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.max_retries           = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.pool_timeout          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.retry_interval        = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.slave_connection      = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.sqlite_synchronous    = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.synchronous_reader    = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] database.use_db_reconnect      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_tracing.insecure = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.connection_string     = messaging:// {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.enabled               = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.es_doc_type           = notification {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.es_scroll_size        = 10000 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.es_scroll_time        = 2m {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.filter_error_trace    = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.hmac_keys             = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.sentinel_service_name = mymaster {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.socket_timeout        = 0.1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.trace_requests        = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler.trace_sqlalchemy      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler_jaeger.process_tags   = {} {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] profiler_otlp.service_name_prefix = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.policy_default_rule = default {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.group          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.helper_command = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] privsep_osbrick.user           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.group         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.helper_command = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] cinder_sys_admin.user          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.auth_section      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.auth_type         = password {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.cafile            = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.certfile          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.collect_timing    = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.insecure          = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.keyfile           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.send_service_user_token = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.split_loggers     = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.timeout           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.tls_ciphers       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] service_user.tls_min_version   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.auth_section            = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.auth_type               = password {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.certfile                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.collect_timing          = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.insecure                = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.keyfile                 = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.region_name             = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.split_loggers           = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.timeout                 = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.tls_ciphers             = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] glance.tls_min_version         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.backend_availability_zone = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.chap_password = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.chap_username =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.disk_geometry = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.driver_client_cert = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.driver_data_namespace = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.driver_use_ssl = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.extra_capabilities = {} {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.filter_function = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.goodness_function = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.iscsi_target_flags =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.iser_port     = 3260 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_host      =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_login     = admin {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_mount_options = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_password  = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_private_key =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_share_path =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.replication_device = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.report_discard_supported = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.target_helper = tgtadm {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.target_port   = 3260 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.target_protocol = iscsi {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.trace_flags   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.use_chap_auth = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_backend_name = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_clear  = zero {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_reports.file_event_handler = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_reports.log_dir           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.backend_host         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.chap_password        = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.chap_username        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.disk_geometry        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.driver_client_cert   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.extra_capabilities   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.filter_function      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.goodness_function    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.iser_helper          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.iser_ip_address      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.iser_port            = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87624) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Sep 12 20:53:52 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_host             = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_login            = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_mount_options    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_password         = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Running cmd (subprocess): mount.quobyte {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_private_key      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_share_path       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.num_shell_tries      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.replication_device   = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.report_discard_supported = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.reserved_percentage  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.scst_target_driver   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.storage_protocol     = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.target_helper        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.target_ip_address    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.target_port          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.target_prefix        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.target_protocol      = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.trace_flags          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.use_chap_auth        = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_clear         = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_clear_size    = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] QuobyteHD.volumes_dir          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_notifications.driver = [] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] key_manager.fixed_key          = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.barbican_api_version  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.barbican_endpoint     = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.barbican_endpoint_type = public {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.barbican_region_name  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.cafile                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.certfile              = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.collect_timing        = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.insecure              = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.keyfile               = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.number_of_retries     = 60 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.retry_delay           = 1 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.send_service_user_token = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.split_loggers         = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.timeout               = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.tls_ciphers           = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.tls_min_version       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.verify_ssl            = True {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican.verify_ssl_path       = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.auth_section = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.auth_type = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.cafile   = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.certfile = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.collect_timing = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.insecure = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.keyfile  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.split_loggers = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.timeout  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.tls_ciphers = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] barbican_service_user.tls_min_version = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.approle_role_id          = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.approle_secret_id        = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.auth_method              = approle {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.auth_path                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.kv_mountpoint            = secret {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.kv_path                  = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.kv_version               = 2 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.namespace                = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.root_token_id            = **** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.ssl_ca_crt_file          = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.timeout                  = 60.0 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.token_file               = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.token_role               = None {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.use_ssl                  = False {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 12 20:53:52 devstack cinder-volume[87287]: DEBUG oslo_service.backend._eventlet.service [None req-68cac8f9-9846-4590-862f-08b81c743dc2 None None] ******************************************************************************** {{(pid=87287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 12 20:53:52 devstack quobyte-client[87626]: Reading configuration file: /etc/quobyte/client.cfg
Sep 12 20:53:52 devstack quobyte-client[87626]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:52 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:52 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:52 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.227s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.volume.driver [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Driver hasn't implemented _init_vendor_properties()
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.driver [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1777687072754, 'free_capacity_gb': 1773.1777687072754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87624) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_db.sqlalchemy.engines [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writer thread running {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.db.sqlalchemy.api [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Building query based on filter {{(pid=87624) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87624) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.keymgr.migration [None req-3bf46633-e1ae-460b-b567-043b40805d5d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 12 20:53:52 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:52 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:52 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.242s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Driver initialization completed successfully.
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Initiating service 3 cleanup
Sep 12 20:53:52 devstack cinder-volume[87624]: INFO cinder.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Service 3 cleanup completed.
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.service [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Creating RPC server for service cinder-volume {{(pid=87624) start /opt/stack/cinder/cinder/service.py:231}}
Sep 12 20:53:52 devstack cinder-volume[87624]: DEBUG cinder.service [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87624) start /opt/stack/cinder/cinder/service.py:237}}
Sep 12 20:53:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:53:53 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:53:53 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:53:53 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Sep 12 20:53:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.240s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:53:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c00fa94-e560-4567-a33e-6fe540ada040 None None] Driver post RPC initialization completed successfully.
Sep 12 20:54:02 devstack cinder-volume[87287]: DEBUG dbcounter [-] [87287] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:54:03 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:54:03 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=2 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:54:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:54:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Flow 'volume_create_manager' (bbef544a-9714-45c7-a25a-9da44b969bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:54:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7970b45c-f4cc-4614-a202-450c37500065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7970b45c-f4cc-4614-a202-450c37500065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-550637495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26378beb-044f-4c5d-aac4-c41865065036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bdf62a3b854ff992ba42c4b183f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:54:52Z,use_quota=True,user_id='579a32bd13e34411b57c27b8846aa734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f892208-21f5-47a8-a03c-18d7e24ec51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f892208-21f5-47a8-a03c-18d7e24ec51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebeeadb-0432-454b-a278-2cba2db61f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebeeadb-0432-454b-a278-2cba2db61f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26378beb-044f-4c5d-aac4-c41865065036', 'volume_name': 'volume-26378beb-044f-4c5d-aac4-c41865065036', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea96b8b-3cfc-4185-b9be-7c74e81e011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea96b8b-3cfc-4185-b9be-7c74e81e011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe592fcd-adf0-4fc9-846f-670c004fcb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Volume 26378beb-044f-4c5d-aac4-c41865065036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26378beb-044f-4c5d-aac4-c41865065036', 'volume_size': 1}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-550637495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26378beb-044f-4c5d-aac4-c41865065036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bdf62a3b854ff992ba42c4b183f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:54:52Z,use_quota=True,user_id='579a32bd13e34411b57c27b8846aa734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Creating volume 26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:54:52 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:52 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 1073741824
Sep 12 20:54:52 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Flow 'volume_create_manager' (a89457b9-81a9-4eb6-930b-ffb99feeca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a9c30e-eb6a-494c-9893-af128150f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a9c30e-eb6a-494c-9893-af128150f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2128591181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c926e3f2-4d21-434d-8e6b-c4c3fe2d383d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec65ea0ef73d4d6890850dcb7f0c8385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:54:52Z,use_quota=True,user_id='5ab6ae0ae9d64a1f9dcbbe2706631791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be3c8f5-dd81-458b-b666-39a18b69398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be3c8f5-dd81-458b-b666-39a18b69398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b87186-ca23-40db-bd81-013eedd72872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b87186-ca23-40db-bd81-013eedd72872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c926e3f2-4d21-434d-8e6b-c4c3fe2d383d', 'volume_name': 'volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccc375c-dc02-4f47-aac4-6166550bae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccc375c-dc02-4f47-aac4-6166550bae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16e781f-0de4-4740-b6c8-c2434a13d768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Volume c926e3f2-4d21-434d-8e6b-c4c3fe2d383d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d', 'volume_size': 1}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:54:52 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 1073741824" returned: 0 in 0.611s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:52 devstack sudo[88493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036
Sep 12 20:54:52 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:53 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2128591181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c926e3f2-4d21-434d-8e6b-c4c3fe2d383d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec65ea0ef73d4d6890850dcb7f0c8385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:54:52Z,use_quota=True,user_id='5ab6ae0ae9d64a1f9dcbbe2706631791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Creating volume c926e3f2-4d21-434d-8e6b-c4c3fe2d383d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:54:53 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe592fcd-adf0-4fc9-846f-670c004fcb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26378beb-044f-4c5d-aac4-c41865065036', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:53 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d 1073741824
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921acd4d-89d2-4015-87af-cbad20cd792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:53 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Volume volume-26378beb-044f-4c5d-aac4-c41865065036 (26378beb-044f-4c5d-aac4-c41865065036): created successfully
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921acd4d-89d2-4015-87af-cbad20cd792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Flow 'volume_create_manager' (bbef544a-9714-45c7-a25a-9da44b969bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:54:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-a5784e47-91fb-450d-af92-67ec5e87dc99 req-d663f037-4206-4066-ab69-18228c878355 tempest-VolumesSnapshotsTestJSON-1793943169 None] Created volume successfully.
Sep 12 20:54:53 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d 1073741824" returned: 0 in 0.527s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:53 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d
Sep 12 20:54:53 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:54 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" returned: 0 in 0.304s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16e781f-0de4-4740-b6c8-c2434a13d768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42349d1-6a87-4834-91f6-36d21528d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:54:54 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Volume volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d (c926e3f2-4d21-434d-8e6b-c4c3fe2d383d): created successfully
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42349d1-6a87-4834-91f6-36d21528d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Flow 'volume_create_manager' (a89457b9-81a9-4eb6-930b-ffb99feeca0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:54:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2a0eed80-9ae7-4ad1-ab94-ae64c97c468e tempest-DeleteServersTestJSON-1229082123 None] Created volume successfully.
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:54:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Creating offline snapshot 0d925b0a-4035-4fa2-a035-f2655fdc0bfd of volume 26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 20:54:54 devstack cinder-volume[87624]: INFO oslo.privsep.daemon [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkr3moqv1/privsep.sock']
Sep 12 20:54:54 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkr3moqv1/privsep.sock
Sep 12 20:54:54 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 12 20:54:55 devstack cinder-volume[87624]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 12 20:54:56 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:56 devstack cinder-volume[87624]: INFO oslo.privsep.daemon [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Spawned new privsep daemon via rootwrap
Sep 12 20:54:56 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Accepted privsep connection to /tmp/tmpkr3moqv1/privsep.sock {{(pid=87624) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 12 20:54:56 devstack cinder-volume[87624]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 12 20:54:56 devstack cinder-volume[87624]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 12 20:54:56 devstack cinder-volume[87624]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 12 20:54:56 devstack cinder-volume[87624]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88551
Sep 12 20:54:56 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb3484-4d0b-4dcc-be01-94cf6cc68cce]: (2,) {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:54:56 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4896c-cf71-4510-afd8-a0968391d36e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:54:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:56 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036
Sep 12 20:54:56 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:56 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036" returned: 0 in 0.765s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:57 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd 1G
Sep 12 20:54:57 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:57 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd 1G" returned: 0 in 0.630s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26378beb-044f-4c5d-aac4-c41865065036 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:57 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26378beb-044f-4c5d-aac4-c41865065036 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd
Sep 12 20:54:57 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:58 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26378beb-044f-4c5d-aac4-c41865065036 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd" returned: 0 in 0.462s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:58 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd is being set with open permissions: ugo+rw
Sep 12 20:54:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:58 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd
Sep 12 20:54:58 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:58 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:58 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info
Sep 12 20:54:58 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:58 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:58 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info is being set with open permissions: ugo+rw
Sep 12 20:54:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:58 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info
Sep 12 20:54:58 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:58 devstack cinder-volume[87624]: WARNING py.warnings [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 12 20:54:58 devstack cinder-volume[87624]:   .first()
Sep 12 20:54:58 devstack cinder-volume[87624]: 
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:54:59 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.info" returned: 0 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.781s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.219s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69eba78-e79e-4a0c-9eb6-2eef41243da4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:54:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-0cb304a9-2e9d-4945-bed4-ac6bc6f3dde4 req-044af6e7-8aae-4ecc-a510-c24e4cf9ddb3 tempest-VolumesSnapshotsTestJSON-1793943169 None] Create snapshot completed successfully
Sep 12 20:54:59 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d
Sep 12 20:54:59 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:54:59 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" returned: 0 in 0.424s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.467s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:54:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77cfde80-ba30-4e65-9e04-9b733e8ae3cf', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:54:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-679974e2-bb80-4a57-bc21-60a5cea91efc req-46c2f755-8f00-4b36-be64-f9eea86c490e tempest-DeleteServersTestJSON-1229082123 None] attachment_update completed successfully.
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "cinder-0d925b0a-4035-4fa2-a035-f2655fdc0bfd-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-0d925b0a-4035-4fa2-a035-f2655fdc0bfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "cinder-quobyte-26378beb-044f-4c5d-aac4-c41865065036" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-quobyte-26378beb-044f-4c5d-aac4-c41865065036" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "cinder-quobyte-0d925b0a-4035-4fa2-a035-f2655fdc0bfd" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-quobyte-0d925b0a-4035-4fa2-a035-f2655fdc0bfd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Deleting offline snapshot 0d925b0a-4035-4fa2-a035-f2655fdc0bfd of volume 26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] snapshot_file for this snap is: volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c709826-ac5d-48af-80f0-5fee3dec1dc4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:00 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd
Sep 12 20:55:00 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:01 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd" returned: 0 in 0.650s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26378beb-044f-4c5d-aac4-c41865065036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 20:55:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19dc9ea-0d9a-483d-9239-3d6bddf9d406]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:01 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036
Sep 12 20:55:01 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:02 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036" returned: 0 in 0.934s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:02 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd
Sep 12 20:55:02 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:03 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd" returned: 0 in 0.882s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:03 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd
Sep 12 20:55:03 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036.0d925b0a-4035-4fa2-a035-f2655fdc0bfd" returned: 0 in 0.498s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:03 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-quobyte-0d925b0a-4035-4fa2-a035-f2655fdc0bfd" released by "_delete_snapshot" :: held 3.222s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-quobyte-26378beb-044f-4c5d-aac4-c41865065036" released by "delete_snapshot" :: held 3.282s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:04 devstack cinder-volume[87624]: WARNING cinder.quota [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:55:04 devstack cinder-volume[87624]: WARNING cinder.quota [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:55:04 devstack cinder-volume[87624]: DEBUG cinder.quota [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Created reservations ['209378ed-b9cd-49ea-aec3-14fdd273ebaa', '21802676-e92a-4b9d-8451-e2a8d1420e52', 'ed6433f1-d014-4294-a20f-670d40bb1539', '7853f7ab-fa46-4ac6-9239-b08056a49029'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Delete snapshot completed successfully.
Sep 12 20:55:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-3bbdf4ff-a4e4-4f2d-9fe9-86bb7bd35568 req-6b91726d-b243-4e55-abe8-652814f96a71 tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-0d925b0a-4035-4fa2-a035-f2655fdc0bfd-delete_snapshot" released by "delete_snapshot" :: held 3.923s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "cinder-26378beb-044f-4c5d-aac4-c41865065036-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-26378beb-044f-4c5d-aac4-c41865065036-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "cinder-quobyte-26378beb-044f-4c5d-aac4-c41865065036" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-quobyte-26378beb-044f-4c5d-aac4-c41865065036" acquired by "delete_volume" :: waited 0.050s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-cfd9a7f7-5390-476a-9981-6a75450082b1 req-6a740b96-8303-4da0-b07a-15dfb3fe15cc tempest-DeleteServersTestJSON-1229082123 None] Terminate volume connection completed successfully.
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-cfd9a7f7-5390-476a-9981-6a75450082b1 req-6a740b96-8303-4da0-b07a-15dfb3fe15cc tempest-DeleteServersTestJSON-1229082123 None] Deleting attachment 77cfde80-ba30-4e65-9e04-9b733e8ae3cf. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b1fa37-04db-4b3d-aab5-d5ed8e50f695]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:06 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036
Sep 12 20:55:06 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:06 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036" returned: 0 in 0.609s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:06 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036
Sep 12 20:55:06 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:07 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26378beb-044f-4c5d-aac4-c41865065036" returned: 0 in 0.423s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-quobyte-26378beb-044f-4c5d-aac4-c41865065036" released by "delete_volume" :: held 1.178s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:07 devstack cinder-volume[87624]: WARNING cinder.quota [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.quota [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Created reservations ['cf6272e3-c402-47bf-88b6-0e265cb7eb4e', 'b25b10ab-eb86-43f1-988d-c973b0404ad2', '811a2ea9-3cfc-4ac0-a46c-2f8e21c8edac', '258feec8-e40f-4046-9b23-82d9bd998449'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:07 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:07 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Flow 'volume_create_manager' (f46a293c-4713-4e75-a5fa-2597c941dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb71e5-4f86-4010-9698-a4874e909bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb71e5-4f86-4010-9698-a4874e909bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-615634530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b4e036-4711-4218-9956-ab90a6b6073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a998d237bb724d509f240344e3c95931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:07Z,use_quota=True,user_id='2f092793c1184e049b29924eb16cf288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c20940-7303-4565-bde9-7f5b09675de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c20940-7303-4565-bde9-7f5b09675de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8569366-6b50-4110-b7a8-cbd1ec1fb5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8569366-6b50-4110-b7a8-cbd1ec1fb5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b4e036-4711-4218-9956-ab90a6b6073f', 'volume_name': 'volume-17b4e036-4711-4218-9956-ab90a6b6073f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805bb6fa-1b82-4d5d-84c0-bb488c8700fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805bb6fa-1b82-4d5d-84c0-bb488c8700fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac94c3f-95c0-4ed1-a373-d6c2f80662d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Volume 17b4e036-4711-4218-9956-ab90a6b6073f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b4e036-4711-4218-9956-ab90a6b6073f', 'volume_size': 1}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-615634530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b4e036-4711-4218-9956-ab90a6b6073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a998d237bb724d509f240344e3c95931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:07Z,use_quota=True,user_id='2f092793c1184e049b29924eb16cf288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Creating volume 17b4e036-4711-4218-9956-ab90a6b6073f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:55:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:07 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f 1073741824
Sep 12 20:55:07 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:07 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.336s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.manager [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:07 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Deleted volume successfully.
Sep 12 20:55:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-013cbb14-b7c5-4841-b5fa-f64fc0ed41d6 req-5aadad51-a153-4683-a909-dff5b7f90acb tempest-VolumesSnapshotsTestJSON-1793943169 None] Lock "cinder-26378beb-044f-4c5d-aac4-c41865065036-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:08 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f 1073741824" returned: 0 in 0.484s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:08 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f
Sep 12 20:55:08 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:08 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f" returned: 0 in 0.321s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac94c3f-95c0-4ed1-a373-d6c2f80662d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b4e036-4711-4218-9956-ab90a6b6073f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ac226d-7fe8-4c75-8c90-7d761f74e899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Volume volume-17b4e036-4711-4218-9956-ab90a6b6073f (17b4e036-4711-4218-9956-ab90a6b6073f): created successfully
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ac226d-7fe8-4c75-8c90-7d761f74e899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Flow 'volume_create_manager' (f46a293c-4713-4e75-a5fa-2597c941dff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ea2cf94e-cdd7-4878-9b04-d399d88e9c99 tempest-VolumesAdminNegativeTest-264130811 None] Created volume successfully.
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Acquiring lock "cinder-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Lock "cinder-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Acquiring lock "cinder-quobyte-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Lock "cinder-quobyte-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[884ac6fc-b8d6-4d9d-a4a1-29eb9437732d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:09 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d
Sep 12 20:55:09 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:09 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" returned: 0 in 0.466s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:09 devstack sudo[89570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d
Sep 12 20:55:09 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:09 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" returned: 0 in 0.421s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Lock "cinder-quobyte-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d" released by "delete_volume" :: held 0.955s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Created reservations ['3c7b9e0e-7888-4201-8f82-826987a917da', '5fa0b5bb-0cdd-4c64-87ee-e22b0de1f752', '2a584a92-5cfc-4d91-8f34-3a191106c38a', '0a4a9f17-091a-4b01-a17c-8f37b0c6d4d4'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:10 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:10 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Acquiring lock "cinder-17b4e036-4711-4218-9956-ab90a6b6073f-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Lock "cinder-17b4e036-4711-4218-9956-ab90a6b6073f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Acquiring lock "cinder-quobyte-17b4e036-4711-4218-9956-ab90a6b6073f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Lock "cinder-quobyte-17b4e036-4711-4218-9956-ab90a6b6073f" acquired by "delete_volume" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:10 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.479s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Deleted volume successfully.
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[91026959-5af2-49a3-951b-d8b9b692f01a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a5f4ea27-fba7-4893-a9de-8f6e9cddc4f8 tempest-DeleteServersTestJSON-1229082123 None] Lock "cinder-c926e3f2-4d21-434d-8e6b-c4c3fe2d383d-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:10 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f
Sep 12 20:55:10 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:11 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f" returned: 0 in 0.556s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:11 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f
Sep 12 20:55:11 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:11 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-17b4e036-4711-4218-9956-ab90a6b6073f" returned: 0 in 0.329s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Lock "cinder-quobyte-17b4e036-4711-4218-9956-ab90a6b6073f" released by "delete_volume" :: held 0.973s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Created reservations ['bd487376-be31-47fb-b9fe-b540322631b9', '6f3a69ee-052b-49ec-877e-6215bdae94a7', 'bdd0dacd-23eb-4d4a-940e-6b6823547a96', '6620ce48-68e6-4a3e-931a-4441bdd1d518'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:11 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:11 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:12 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:12 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Deleted volume successfully.
Sep 12 20:55:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c35dd560-8307-4e28-834e-a7fe80e493df tempest-VolumesAdminNegativeTest-264130811 None] Lock "cinder-17b4e036-4711-4218-9956-ab90a6b6073f-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Flow 'volume_create_manager' (ffa5bb89-5419-48a3-b19d-e957cfdb1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a6e667-9a38-4b55-92f2-a0d1c335930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a6e667-9a38-4b55-92f2-a0d1c335930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-65970194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df8b5ba-2057-49e9-b29d-a0aab0efffc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aeae2b140bd4a3a8bde327a30be5541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:15Z,use_quota=True,user_id='74969c4d12504eb2a0c8c6b32a88de62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7efc4b7-e868-4c25-bb98-9fc9d9b2f869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7efc4b7-e868-4c25-bb98-9fc9d9b2f869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa123b5c-6248-4c3d-bbac-f595f2db55a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa123b5c-6248-4c3d-bbac-f595f2db55a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df8b5ba-2057-49e9-b29d-a0aab0efffc9', 'volume_name': 'volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9661e59-b18b-4566-a218-6f808c06aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9661e59-b18b-4566-a218-6f808c06aaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57421425-feef-4f6a-b812-844e1daead68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Volume 0df8b5ba-2057-49e9-b29d-a0aab0efffc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9', 'volume_size': 1}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-65970194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df8b5ba-2057-49e9-b29d-a0aab0efffc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aeae2b140bd4a3a8bde327a30be5541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:15Z,use_quota=True,user_id='74969c4d12504eb2a0c8c6b32a88de62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Creating volume 0df8b5ba-2057-49e9-b29d-a0aab0efffc9 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:55:14 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:55:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:14 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 1073741824
Sep 12 20:55:14 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:15 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 1073741824" returned: 0 in 0.419s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:15 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9
Sep 12 20:55:15 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:15 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9" returned: 0 in 0.248s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57421425-feef-4f6a-b812-844e1daead68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1608e8ea-08cf-49b4-891d-53f856626c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Volume volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 (0df8b5ba-2057-49e9-b29d-a0aab0efffc9): created successfully
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1608e8ea-08cf-49b4-891d-53f856626c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Flow 'volume_create_manager' (ffa5bb89-5419-48a3-b19d-e957cfdb1fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e4109424-3cf4-4314-adba-a1024cba4cb1 tempest-VolumesTestJSON-1249842658 None] Created volume successfully.
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Flow 'volume_create_manager' (7c3f11ff-47c0-4ef1-85c5-8f5f57ec277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c1d1bf-b141-4f80-8762-f6ef0aa44219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c1d1bf-b141-4f80-8762-f6ef0aa44219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648800768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69d3a00-bf40-42a0-9ee7-4c13d408c5a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aeae2b140bd4a3a8bde327a30be5541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:17Z,use_quota=True,user_id='74969c4d12504eb2a0c8c6b32a88de62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b69dd6b-dbea-49ad-945a-5df1a111628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b69dd6b-dbea-49ad-945a-5df1a111628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86100e9-cfcd-48f4-877b-4d4f60c10ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86100e9-cfcd-48f4-877b-4d4f60c10ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c69d3a00-bf40-42a0-9ee7-4c13d408c5a8', 'volume_name': 'volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44923e3-122a-42da-a546-52ff0348112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44923e3-122a-42da-a546-52ff0348112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923efa0f-7ecc-4ffb-8863-07b4701f729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Volume c69d3a00-bf40-42a0-9ee7-4c13d408c5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8', 'volume_size': 1}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648800768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69d3a00-bf40-42a0-9ee7-4c13d408c5a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aeae2b140bd4a3a8bde327a30be5541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:17Z,use_quota=True,user_id='74969c4d12504eb2a0c8c6b32a88de62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Creating volume c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:55:17 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:17 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 1073741824
Sep 12 20:55:17 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:17 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 1073741824" returned: 0 in 0.643s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:18 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8
Sep 12 20:55:18 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:18 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8" returned: 0 in 0.263s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923efa0f-7ecc-4ffb-8863-07b4701f729a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bedcc-f262-47cb-b86b-917b0e520754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:18 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Volume volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 (c69d3a00-bf40-42a0-9ee7-4c13d408c5a8): created successfully
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bedcc-f262-47cb-b86b-917b0e520754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Flow 'volume_create_manager' (7c3f11ff-47c0-4ef1-85c5-8f5f57ec277a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c32be1fc-ba39-46ae-8f72-025b821c68d7 tempest-VolumesTestJSON-1249842658 None] Created volume successfully.
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Flow 'volume_create_manager' (43bb9eca-fc85-4a98-996e-5232132e1e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18639f89-ec21-48e0-b5cb-74af696ee582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18639f89-ec21-48e0-b5cb-74af696ee582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1572285817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aeae2b140bd4a3a8bde327a30be5541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:20Z,use_quota=True,user_id='74969c4d12504eb2a0c8c6b32a88de62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df08bbbf-e2cd-4fd2-9ea8-2c04129e73b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df08bbbf-e2cd-4fd2-9ea8-2c04129e73b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38547bcc-3e94-441c-b138-d4344f498399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38547bcc-3e94-441c-b138-d4344f498399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e', 'volume_name': 'volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5ee721-47af-4463-a644-48e4c2416688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5ee721-47af-4463-a644-48e4c2416688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6102f789-0b34-4923-8b4a-7cae7a71fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:20 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Volume 3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e', 'volume_size': 1}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1572285817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aeae2b140bd4a3a8bde327a30be5541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:20Z,use_quota=True,user_id='74969c4d12504eb2a0c8c6b32a88de62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Creating volume 3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:55:20 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:20 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e 1073741824
Sep 12 20:55:20 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:20 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e 1073741824" returned: 0 in 0.523s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:20 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e
Sep 12 20:55:20 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:20 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e" returned: 0 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:55:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6102f789-0b34-4923-8b4a-7cae7a71fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc8361a-a56e-45ef-8a82-62c4d7b8a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:21 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Volume volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e (3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e): created successfully
Sep 12 20:55:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc8361a-a56e-45ef-8a82-62c4d7b8a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Flow 'volume_create_manager' (43bb9eca-fc85-4a98-996e-5232132e1e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-54254361-0d66-484f-905a-dbc905ec7a07 tempest-VolumesTestJSON-1249842658 None] Created volume successfully.
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Acquiring lock "cinder-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Lock "cinder-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Acquiring lock "cinder-quobyte-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Lock "cinder-quobyte-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdabaa43-f46d-4b94-b8fd-d76d797e74da]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:23 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e
Sep 12 20:55:23 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:23 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:23 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e
Sep 12 20:55:23 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:24 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Lock "cinder-quobyte-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e" released by "delete_volume" :: held 0.670s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Created reservations ['f545ae7e-6994-49ea-968a-1d4f14f0ff8f', '6a7e768c-7304-4daf-984d-669f6f2c5a3c', 'c0893ae2-7e8d-4312-9911-fa61549acba8', '3ac3d717-6ed6-4390-ad6d-9a0eb693af09'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:24 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:24 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "cinder-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:24 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.434s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Deleted volume successfully.
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "cinder-quobyte-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-quobyte-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2818795f-3e82-4fa8-ae18-228539c335ad tempest-VolumesTestJSON-1249842658 None] Lock "cinder-3d5de9fb-c2a3-4462-b43c-d64b95fb4f4e-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda6dd09-6fe7-4fba-b8c5-7a9076363e7a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:24 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8
Sep 12 20:55:24 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:25 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8" returned: 0 in 0.420s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:25 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8
Sep 12 20:55:25 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:25 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8" returned: 0 in 0.332s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-quobyte-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8" released by "delete_volume" :: held 0.799s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Created reservations ['c5c22d30-fd4f-4237-b5b1-d879d063c557', '2f9168fc-19df-4581-a324-9b0dd09c9b46', 'dc72bf64-900c-43cd-8dbc-d762f9ebd7a9', '5e6149bd-9966-4fed-81c7-fa07c8807d61'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:25 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:25 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "cinder-0df8b5ba-2057-49e9-b29d-a0aab0efffc9-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-0df8b5ba-2057-49e9-b29d-a0aab0efffc9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "cinder-quobyte-0df8b5ba-2057-49e9-b29d-a0aab0efffc9" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-quobyte-0df8b5ba-2057-49e9-b29d-a0aab0efffc9" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[da22dc4c-eae5-4bb1-b573-7aba1ccaf071]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:26 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Deleted volume successfully.
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a652b284-cc91-4589-a759-ad233a8484e9 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-c69d3a00-bf40-42a0-9ee7-4c13d408c5a8-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:26 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9
Sep 12 20:55:26 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:26 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9" returned: 0 in 0.508s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:26 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9
Sep 12 20:55:26 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:26 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df8b5ba-2057-49e9-b29d-a0aab0efffc9" returned: 0 in 0.316s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-quobyte-0df8b5ba-2057-49e9-b29d-a0aab0efffc9" released by "delete_volume" :: held 0.887s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:26 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Created reservations ['a847b62d-53d0-495f-a9a6-ffbcd640b20b', '7a286df1-015a-46b6-8df4-3326d90146a0', '5d0918f0-57a9-4970-9cb5-9e3d6440e893', '7739fd68-d638-48ae-8745-d51bcb716d05'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:27 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:27 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:27 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.265s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Deleted volume successfully.
Sep 12 20:55:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a3585ca3-bf07-4e45-8a9a-2ba72db52d88 tempest-VolumesTestJSON-1249842658 None] Lock "cinder-0df8b5ba-2057-49e9-b29d-a0aab0efffc9-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:33 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:55:33 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:33 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:55:37 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=59,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:55:37 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=56,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:55:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-42b82dc3-3bb4-46b4-b4f0-7a4c471ef0e2 tempest-GroupSnapshotsTest-125817033 None] Group tempest-GroupSnapshotsTest-Group-1225963360: creating
Sep 12 20:55:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-42b82dc3-3bb4-46b4-b4f0-7a4c471ef0e2 tempest-GroupSnapshotsTest-125817033 None] Group tempest-GroupSnapshotsTest-Group-1225963360: created successfully
Sep 12 20:55:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-42b82dc3-3bb4-46b4-b4f0-7a4c471ef0e2 tempest-GroupSnapshotsTest-125817033 None] Create group completed successfully.
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (2fa19f4d-ef2f-4dee-a76d-c7c1f3616bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcddd86-2d8e-41e2-9822-284002144ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcddd86-2d8e-41e2-9822-284002144ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-931325758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cff5279a-cd91-43bd-a054-0f678a729022,host='devstack@QuobyteHD#QuobyteHD',id=ff5da62a-1ab8-4626-9f9b-175db34092d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:41Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13da53e-889e-4c63-bbfa-7bee27725a14),volume_type_id=f13da53e-889e-4c63-bbfa-7bee27725a14)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793d1484-8b1a-4643-883b-89253a73b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793d1484-8b1a-4643-883b-89253a73b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a14c2cf-3734-40c8-a85f-3a83aeb55c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a14c2cf-3734-40c8-a85f-3a83aeb55c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5da62a-1ab8-4626-9f9b-175db34092d6', 'volume_name': 'volume-ff5da62a-1ab8-4626-9f9b-175db34092d6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447a227f-ee31-4a53-bca2-a3e36699f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447a227f-ee31-4a53-bca2-a3e36699f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12800d0c-259c-4af9-ab99-c9f9fc3dc335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Volume ff5da62a-1ab8-4626-9f9b-175db34092d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5da62a-1ab8-4626-9f9b-175db34092d6', 'volume_size': 1}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cff5279a-cd91-43bd-a054-0f678a729022,created_at=2026-09-12T18:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-931325758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cff5279a-cd91-43bd-a054-0f678a729022,host='devstack@QuobyteHD#QuobyteHD',id=ff5da62a-1ab8-4626-9f9b-175db34092d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:55:41Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13da53e-889e-4c63-bbfa-7bee27725a14),volume_type_id=f13da53e-889e-4c63-bbfa-7bee27725a14)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Creating volume ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:55:41 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:41 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 1073741824
Sep 12 20:55:41 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:41 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 1073741824" returned: 0 in 0.679s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:42 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:55:42 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:42 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12800d0c-259c-4af9-ab99-c9f9fc3dc335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5da62a-1ab8-4626-9f9b-175db34092d6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc30b48d-baee-4cc0-86fe-963d7dab0aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:55:42 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Volume volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 (ff5da62a-1ab8-4626-9f9b-175db34092d6): created successfully
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc30b48d-baee-4cc0-86fe-963d7dab0aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:55:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (2fa19f4d-ef2f-4dee-a76d-c7c1f3616bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:55:42 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-12b79777-4f7b-468f-bd42-703df63abdc8 tempest-GroupSnapshotsTest-125817033 None] Created volume successfully.
Sep 12 20:55:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] GroupSnapshot 67d3474f-4bf3-4ff2-87d6-30fa13c9429a: creating.
Sep 12 20:55:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Group snapshot 67d3474f-4bf3-4ff2-87d6-30fa13c9429a: creating. {{(pid=87624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 12 20:55:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Creating offline snapshot a1691d64-35ef-4729-9ead-5113f516d11c of volume ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 20:55:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d544ed-2007-4aac-a0a2-cf03f34476aa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:44 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:55:44 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:45 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.699s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:45 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c 1G
Sep 12 20:55:45 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:46 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c 1G" returned: 0 in 1.059s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:46 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c
Sep 12 20:55:46 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:47 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c" returned: 0 in 0.630s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:47 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:55:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:47 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c
Sep 12 20:55:47 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:47 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:47 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info
Sep 12 20:55:47 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:47 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info" returned: 0 in 0.415s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:47 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:55:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:48 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info
Sep 12 20:55:48 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:48 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.info" returned: 0 in 0.541s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.935s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d2b3172b-bfe7-4f2a-a853-0945399afd4e tempest-GroupSnapshotsTest-125817033 None] group_snapshot 67d3474f-4bf3-4ff2-87d6-30fa13c9429a: created successfully
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-a1691d64-35ef-4729-9ead-5113f516d11c-973aec98-8583-4ebc-8e84-cea53f7d0308" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-a1691d64-35ef-4729-9ead-5113f516d11c-973aec98-8583-4ebc-8e84-cea53f7d0308" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Creating volume 973aec98-8583-4ebc-8e84-cea53f7d0308 from snapshot a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-973aec98-8583-4ebc-8e84-cea53f7d0308" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-973aec98-8583-4ebc-8e84-cea53f7d0308" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] snapshot: a1691d64-35ef-4729-9ead-5113f516d11c, volume: 973aec98-8583-4ebc-8e84-cea53f7d0308,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[715fac9a-70b8-4a62-b744-f3266c2f234c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:50 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c
Sep 12 20:55:50 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:50 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c" returned: 0 in 0.672s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff5da62a-1ab8-4626-9f9b-175db34092d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c1a958-c8a7-4174-84a5-b5da06d2ec72]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:51 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:55:51 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:51 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.710s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 20:55:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:51 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308
Sep 12 20:55:51 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:58 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308" returned: 0 in 6.973s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:58 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[39366bc5-dc97-4c95-966c-00efa724df7e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:55:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:58 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:55:58 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:59 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.623s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 20:55:59 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Converted 1024.00 MB image at 146.83 MB/s
Sep 12 20:55:59 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:55:59 devstack sudo[90079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308
Sep 12 20:55:59 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:55:59 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308" returned: 0 in 0.309s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-973aec98-8583-4ebc-8e84-cea53f7d0308" released by "_copy_volume_from_snapshot" :: held 9.413s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-a1691d64-35ef-4729-9ead-5113f516d11c-973aec98-8583-4ebc-8e84-cea53f7d0308" released by "_create_volume_from_snapshot" :: held 9.485s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:55:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.552s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:55:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b454ff44-5416-4172-95d2-4e1b2f7a65cc tempest-GroupSnapshotsTest-125817033 None] Create group from source-snapshot-67d3474f-4bf3-4ff2-87d6-30fa13c9429a completed successfully.
Sep 12 20:56:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-973aec98-8583-4ebc-8e84-cea53f7d0308" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-973aec98-8583-4ebc-8e84-cea53f7d0308" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea6297-377c-4d67-ad14-95dcad593794]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:01 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308
Sep 12 20:56:01 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:02 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308" returned: 0 in 0.547s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:02 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308
Sep 12 20:56:02 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:02 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-973aec98-8583-4ebc-8e84-cea53f7d0308" returned: 0 in 0.719s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-973aec98-8583-4ebc-8e84-cea53f7d0308" released by "delete_volume" :: held 1.366s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Created reservations ['24844f1e-bf54-4a2d-aa85-1132500ca19d'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:03 devstack cinder-volume[87624]: WARNING cinder.quota [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-999274791 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-999274791, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:56:03 devstack cinder-volume[87624]: WARNING cinder.quota [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-999274791 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-999274791, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Created reservations ['2da30772-639d-4cc1-97c4-0c8d2edcf2d9', '9ce7d851-f4a4-4976-a671-9c6a5fc461ae', '0e89b7b0-6a83-4bc5-ac7a-04ca0bff0480', '9f3defd5-ab84-4d58-8416-f8ed0420d2d7'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:03 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:56:03 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:03 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.635s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:03 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:56:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-969e6c67-eb55-4d0c-8d3e-92b14d296baf tempest-GroupSnapshotsTest-125817033 None] Delete group completed successfully.
Sep 12 20:56:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 67d3474f-4bf3-4ff2-87d6-30fa13c9429a: deleting
Sep 12 20:56:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 67d3474f-4bf3-4ff2-87d6-30fa13c9429a: deleting {{(pid=87624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 12 20:56:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-ff5da62a-1ab8-4626-9f9b-175db34092d6" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-ff5da62a-1ab8-4626-9f9b-175db34092d6" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-a1691d64-35ef-4729-9ead-5113f516d11c" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-a1691d64-35ef-4729-9ead-5113f516d11c" acquired by "_delete_snapshot" :: waited 0.096s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Deleting offline snapshot a1691d64-35ef-4729-9ead-5113f516d11c of volume ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 20:56:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] snapshot_file for this snap is: volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 20:56:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9adf859-78d5-43b5-b6ac-20511cbd5e89]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:05 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c
Sep 12 20:56:05 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:05 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c" returned: 0 in 0.921s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff5da62a-1ab8-4626-9f9b-175db34092d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 20:56:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab552e-093f-4b78-8904-cb1981a2c48d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:06 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:56:06 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:06 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.787s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:06 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c
Sep 12 20:56:06 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:07 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c" returned: 0 in 0.721s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:07 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c
Sep 12 20:56:07 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:08 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6.a1691d64-35ef-4729-9ead-5113f516d11c" returned: 0 in 0.592s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-a1691d64-35ef-4729-9ead-5113f516d11c" released by "_delete_snapshot" :: held 3.390s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-ff5da62a-1ab8-4626-9f9b-175db34092d6" released by "delete_snapshot" :: held 3.519s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:08 devstack cinder-volume[87624]: WARNING cinder.quota [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-999274791 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-999274791, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:56:08 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] Created reservations ['11e2ec63-9e4e-4d50-ac24-c7bb15aa390d', 'd9279140-5133-44c7-a773-ac91008045e7', '9904c89d-d17c-484f-87ca-d5c29a31b9b6', '511bd508-7a09-4b39-8a6c-36171aacef9d'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-dabe3715-636f-4bb4-b993-c7edd0c3ae83 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 67d3474f-4bf3-4ff2-87d6-30fa13c9429a: deleted successfully
Sep 12 20:56:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-ff5da62a-1ab8-4626-9f9b-175db34092d6" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-ff5da62a-1ab8-4626-9f9b-175db34092d6" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e513fe3-02e7-4570-b2ea-2b3865c9b530]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:09 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:56:09 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:10 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.660s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:10 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6
Sep 12 20:56:10 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:10 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ff5da62a-1ab8-4626-9f9b-175db34092d6" returned: 0 in 0.393s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-ff5da62a-1ab8-4626-9f9b-175db34092d6" released by "delete_volume" :: held 1.157s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Created reservations ['2d079483-f85b-4880-811f-0c1ca6b83fb0'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:10 devstack cinder-volume[87624]: WARNING cinder.db.sqlalchemy.api [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-999274791']
Sep 12 20:56:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Created reservations ['bd303653-4fa5-47f0-8ee4-22a67524f08e', 'e9f2877e-255a-4503-a5b8-70cdefb17ebf', '109b4be6-7062-48bc-9258-448ad7ef355f', 'f9cfaae9-dcdf-44b3-a3f1-233514df21fa'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:11 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:56:11 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:11 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.402s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:11 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:56:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9ae7a3b4-d103-47ea-9930-23d5b49f151c tempest-GroupSnapshotsTest-125817033 None] Delete group completed successfully.
Sep 12 20:56:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-639f9b22-0e3e-4b09-8342-484b2f9a7c18 tempest-GroupSnapshotsTest-125817033 None] Group tempest-GroupSnapshotsTest-Group-2062597013: creating
Sep 12 20:56:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-639f9b22-0e3e-4b09-8342-484b2f9a7c18 tempest-GroupSnapshotsTest-125817033 None] Group tempest-GroupSnapshotsTest-Group-2062597013: created successfully
Sep 12 20:56:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-639f9b22-0e3e-4b09-8342-484b2f9a7c18 tempest-GroupSnapshotsTest-125817033 None] Create group completed successfully.
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Flow 'volume_create_manager' (90c4166f-5cdd-41f2-a38e-ecc81b21c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1467076a-ce1b-4a2c-ad52-57709c7b792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1467076a-ce1b-4a2c-ad52-57709c7b792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2105248321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57a76d1-5b7d-420c-8490-039d3d927537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d42a240e6b4fd89856ed68b312e8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:15Z,use_quota=True,user_id='45c9aee36fe242a3936c247a28f6228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fbea01-d855-473e-8e02-c9daad5fe222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fbea01-d855-473e-8e02-c9daad5fe222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e64a3ff-8f44-49e2-b2c2-563a7ac4ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e64a3ff-8f44-49e2-b2c2-563a7ac4ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57a76d1-5b7d-420c-8490-039d3d927537', 'volume_name': 'volume-f57a76d1-5b7d-420c-8490-039d3d927537', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc21932-6c5f-497d-be05-38837fe82bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc21932-6c5f-497d-be05-38837fe82bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6058294f-e1c7-4378-ac7e-3e4bb4feacef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Volume f57a76d1-5b7d-420c-8490-039d3d927537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57a76d1-5b7d-420c-8490-039d3d927537', 'volume_size': 1}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2105248321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57a76d1-5b7d-420c-8490-039d3d927537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d42a240e6b4fd89856ed68b312e8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:15Z,use_quota=True,user_id='45c9aee36fe242a3936c247a28f6228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Creating volume f57a76d1-5b7d-420c-8490-039d3d927537 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:56:15 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:56:15 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 1073741824
Sep 12 20:56:15 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (96c25dd5-7716-499b-accb-c4295e7bdf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39934451-6db9-4ba5-9118-2464c808976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39934451-6db9-4ba5-9118-2464c808976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-798136208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74706b22-8a62-4bd9-940d-362f8250762f,host='devstack@QuobyteHD#QuobyteHD',id=6916c632-308c-4744-903c-8792a71d730c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:15Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e7e658c-9495-4f39-bf23-4db599ebc8e1),volume_type_id=2e7e658c-9495-4f39-bf23-4db599ebc8e1)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1a8c49-dc00-43d7-bff5-0c93bbe9c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1a8c49-dc00-43d7-bff5-0c93bbe9c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69ea65e-02c0-4bdb-b439-b3d7750eee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69ea65e-02c0-4bdb-b439-b3d7750eee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6916c632-308c-4744-903c-8792a71d730c', 'volume_name': 'volume-6916c632-308c-4744-903c-8792a71d730c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5554f12b-7cc6-4915-b2a6-22fe5843281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5554f12b-7cc6-4915-b2a6-22fe5843281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf37289-9b6a-40a9-8133-60bcb03fddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Volume 6916c632-308c-4744-903c-8792a71d730c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6916c632-308c-4744-903c-8792a71d730c', 'volume_size': 1}
Sep 12 20:56:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Flow 'volume_create_manager' (3613a2d4-41b1-4ee3-b3b0-0a82fc807eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f28a1cd-ef9b-4649-b222-5040b3fc8a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f28a1cd-ef9b-4649-b222-5040b3fc8a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-444272104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b527484-7f41-4c2b-b6fc-d6c07f782af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7521198bfc5943628aa8754c5ddb432c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:16Z,use_quota=True,user_id='c12b1d60d6d04c5c92744681e31ed7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4130f9c0-2e4c-4514-b777-91dfb4f77afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4130f9c0-2e4c-4514-b777-91dfb4f77afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57632f6d-ab06-480c-a364-5b0a0c36be80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57632f6d-ab06-480c-a364-5b0a0c36be80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b527484-7f41-4c2b-b6fc-d6c07f782af6', 'volume_name': 'volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fc764e-9802-4bb4-be9d-89834d50ef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fc764e-9802-4bb4-be9d-89834d50ef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c79cbd2-d7cf-42ce-91e8-ee05b16249ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Volume 9b527484-7f41-4c2b-b6fc-d6c07f782af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6', 'volume_size': 1}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:16 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 1073741824" returned: 0 in 0.952s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:16 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537
Sep 12 20:56:16 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:16 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537" returned: 0 in 0.422s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=74706b22-8a62-4bd9-940d-362f8250762f,created_at=2026-09-12T18:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-798136208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74706b22-8a62-4bd9-940d-362f8250762f,host='devstack@QuobyteHD#QuobyteHD',id=6916c632-308c-4744-903c-8792a71d730c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:15Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e7e658c-9495-4f39-bf23-4db599ebc8e1),volume_type_id=2e7e658c-9495-4f39-bf23-4db599ebc8e1)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Creating volume 6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:56:16 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:56:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6058294f-e1c7-4378-ac7e-3e4bb4feacef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57a76d1-5b7d-420c-8490-039d3d927537', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:17 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c 1073741824
Sep 12 20:56:17 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d1a120-5f1a-4c3a-af62-39bd5b08674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Volume volume-f57a76d1-5b7d-420c-8490-039d3d927537 (f57a76d1-5b7d-420c-8490-039d3d927537): created successfully
Sep 12 20:56:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d1a120-5f1a-4c3a-af62-39bd5b08674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Flow 'volume_create_manager' (90c4166f-5cdd-41f2-a38e-ecc81b21c99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-660c7cd7-24fa-4d50-8da4-c488f6c53728 tempest-ServerActionsTestOtherA-1572891832 None] Created volume successfully.
Sep 12 20:56:17 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c 1073741824" returned: 0 in 0.768s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:17 devstack sudo[90326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c
Sep 12 20:56:17 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:18 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-444272104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b527484-7f41-4c2b-b6fc-d6c07f782af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7521198bfc5943628aa8754c5ddb432c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:16Z,use_quota=True,user_id='c12b1d60d6d04c5c92744681e31ed7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Creating volume 9b527484-7f41-4c2b-b6fc-d6c07f782af6 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:56:18 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:18 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 1073741824
Sep 12 20:56:18 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf37289-9b6a-40a9-8133-60bcb03fddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6916c632-308c-4744-903c-8792a71d730c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3c87ac-5bf6-44e6-b06a-2aa870382fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:18 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Volume volume-6916c632-308c-4744-903c-8792a71d730c (6916c632-308c-4744-903c-8792a71d730c): created successfully
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3c87ac-5bf6-44e6-b06a-2aa870382fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (96c25dd5-7716-499b-accb-c4295e7bdf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8744e901-d9a9-4b71-bb60-6911cab187c5 tempest-GroupSnapshotsTest-125817033 None] Created volume successfully.
Sep 12 20:56:18 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 1073741824" returned: 0 in 0.699s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:19 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6
Sep 12 20:56:19 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:19 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c79cbd2-d7cf-42ce-91e8-ee05b16249ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c6eb2f-89c5-46ec-ab0f-aa358700ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:19 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Volume volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 (9b527484-7f41-4c2b-b6fc-d6c07f782af6): created successfully
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c6eb2f-89c5-46ec-ab0f-aa358700ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Flow 'volume_create_manager' (3613a2d4-41b1-4ee3-b3b0-0a82fc807eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f1196745-cda1-4dea-a8a9-8a2b2b9bdc76 tempest-ServerRescueNegativeTestJSON-316055884 None] Created volume successfully.
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (3439b45f-0b0d-4cfd-a0f5-3d62a0e27da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5a4db3-b693-4a22-b61e-dc77837111d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5a4db3-b693-4a22-b61e-dc77837111d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-11406096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74706b22-8a62-4bd9-940d-362f8250762f,host='devstack@QuobyteHD#QuobyteHD',id=f9e3b384-304b-49b8-a99f-e78ccef3dc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:20Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e7e658c-9495-4f39-bf23-4db599ebc8e1),volume_type_id=2e7e658c-9495-4f39-bf23-4db599ebc8e1)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b7cb0a-12ad-4448-bf2a-c56603a90079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b7cb0a-12ad-4448-bf2a-c56603a90079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf22f7d9-5a0b-4c39-86b1-010d58addf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf22f7d9-5a0b-4c39-86b1-010d58addf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e3b384-304b-49b8-a99f-e78ccef3dc5f', 'volume_name': 'volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a1afd5-171b-4f12-90b4-2242ea6ea394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a1afd5-171b-4f12-90b4-2242ea6ea394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b18cd81-cced-4dac-9f3d-aed5139e3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:20 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Volume f9e3b384-304b-49b8-a99f-e78ccef3dc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f', 'volume_size': 1}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=74706b22-8a62-4bd9-940d-362f8250762f,created_at=2026-09-12T18:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-11406096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74706b22-8a62-4bd9-940d-362f8250762f,host='devstack@QuobyteHD#QuobyteHD',id=f9e3b384-304b-49b8-a99f-e78ccef3dc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:20Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e7e658c-9495-4f39-bf23-4db599ebc8e1),volume_type_id=2e7e658c-9495-4f39-bf23-4db599ebc8e1)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Creating volume f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:56:20 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:56:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:20 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f 1073741824
Sep 12 20:56:20 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:21 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f 1073741824" returned: 0 in 0.779s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:21 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f
Sep 12 20:56:21 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:21 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" returned: 0 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b18cd81-cced-4dac-9f3d-aed5139e3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cf0db2-b4ab-4192-b1fb-a79ff4eb13bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:21 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Volume volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f (f9e3b384-304b-49b8-a99f-e78ccef3dc5f): created successfully
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cf0db2-b4ab-4192-b1fb-a79ff4eb13bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (3439b45f-0b0d-4cfd-a0f5-3d62a0e27da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e43edf39-d3a2-45e0-a43e-ed487da037e8 tempest-GroupSnapshotsTest-125817033 None] Created volume successfully.
Sep 12 20:56:23 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-99d483ac-39a9-4496-989e-4136e15c9ff8 tempest-GroupSnapshotsTest-125817033 None] Update group completed successfully.
Sep 12 20:56:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d644207e-2e3a-40c2-8d3c-f4f15f39ba50 tempest-GroupSnapshotsTest-125817033 None] Update group completed successfully.
Sep 12 20:56:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-28132135-42cd-4411-8f0e-7a4801098dcc tempest-GroupSnapshotsTest-125817033 None] Update group completed successfully.
Sep 12 20:56:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-eca3349b-ea2b-4eb4-8414-dec1e2741087 tempest-GroupSnapshotsTest-125817033 None] Update group completed successfully.
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Flow 'volume_create_manager' (7ac884ae-18da-4171-a5e0-0d9e435483cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3bfbc7-cbbd-4da8-8dbf-1c2fd77cbde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3bfbc7-cbbd-4da8-8dbf-1c2fd77cbde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-600145144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c3494e-829c-4ad3-a975-2d1a024840ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd1a027ba84ee9b8994f8d6fb75945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:29Z,use_quota=True,user_id='6f90b60494834f048ca1cd1a699bffff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5e8f89-b28b-4279-b280-96354184baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5e8f89-b28b-4279-b280-96354184baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28699b9-c243-4415-8a50-a65046d1713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28699b9-c243-4415-8a50-a65046d1713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c3494e-829c-4ad3-a975-2d1a024840ed', 'volume_name': 'volume-37c3494e-829c-4ad3-a975-2d1a024840ed', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ff1092-c057-4139-9298-5fdb769a6db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ff1092-c057-4139-9298-5fdb769a6db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6406994b-1677-4b07-a0ab-8a72b2c9b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:28 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Volume 37c3494e-829c-4ad3-a975-2d1a024840ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c3494e-829c-4ad3-a975-2d1a024840ed', 'volume_size': 1}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-600145144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c3494e-829c-4ad3-a975-2d1a024840ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd1a027ba84ee9b8994f8d6fb75945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:29Z,use_quota=True,user_id='6f90b60494834f048ca1cd1a699bffff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Creating volume 37c3494e-829c-4ad3-a975-2d1a024840ed {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:56:28 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:56:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:28 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed 1073741824
Sep 12 20:56:28 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:29 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed 1073741824" returned: 0 in 0.881s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:29 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed
Sep 12 20:56:29 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] GroupSnapshot 1082be9b-08bb-4006-8801-7ccf98da813d: creating.
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Group snapshot 1082be9b-08bb-4006-8801-7ccf98da813d: creating. {{(pid=87624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:29 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.128s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6406994b-1677-4b07-a0ab-8a72b2c9b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c3494e-829c-4ad3-a975-2d1a024840ed', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bc9146-ab2f-43d0-bafe-9f3ee9e93cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Creating offline snapshot 855e9fef-7e43-49e9-ac47-f5b66ff41659 of volume 6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 20:56:30 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Volume volume-37c3494e-829c-4ad3-a975-2d1a024840ed (37c3494e-829c-4ad3-a975-2d1a024840ed): created successfully
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bc9146-ab2f-43d0-bafe-9f3ee9e93cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Flow 'volume_create_manager' (7ac884ae-18da-4171-a5e0-0d9e435483cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab86386-dbf2-4f63-9b14-9608440223ea]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d802251d-7598-40e9-8972-139b700ccb56 tempest-TaggedAttachmentsTest-43408903 None] Created volume successfully.
Sep 12 20:56:30 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c
Sep 12 20:56:30 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:30 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c" returned: 0 in 0.528s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:30 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 1G
Sep 12 20:56:30 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:31 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 1G" returned: 0 in 0.586s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6916c632-308c-4744-903c-8792a71d730c -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:31 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6916c632-308c-4744-903c-8792a71d730c -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659
Sep 12 20:56:31 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:31 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6916c632-308c-4744-903c-8792a71d730c -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659" returned: 0 in 0.534s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:31 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:56:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:31 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659
Sep 12 20:56:31 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:32 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659" returned: 0 in 0.563s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:32 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info
Sep 12 20:56:32 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Acquiring lock "cinder-9b527484-7f41-4c2b-b6fc-d6c07f782af6-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "cinder-9b527484-7f41-4c2b-b6fc-d6c07f782af6-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Acquiring lock "cinder-quobyte-9b527484-7f41-4c2b-b6fc-d6c07f782af6" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "cinder-quobyte-9b527484-7f41-4c2b-b6fc-d6c07f782af6" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:32 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info" returned: 0 in 0.565s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:32 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd6ab8-ede3-4644-b277-093000f2a02f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:32 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info
Sep 12 20:56:32 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:33 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.info" returned: 0 in 0.389s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:33 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6
Sep 12 20:56:33 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Creating offline snapshot faa215e6-1c2d-4d29-96b8-7aa785c980ef of volume f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedfcf01-3076-432f-964f-3758e414d76a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:33 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:56:33 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:33 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f
Sep 12 20:56:33 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:33 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.538s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:56:34 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6" returned: 0 in 1.283s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:34 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6
Sep 12 20:56:34 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:34 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" returned: 0 in 1.020s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:34 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef 1G
Sep 12 20:56:34 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:35 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9b527484-7f41-4c2b-b6fc-d6c07f782af6" returned: 0 in 0.970s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "cinder-quobyte-9b527484-7f41-4c2b-b6fc-d6c07f782af6" released by "delete_volume" :: held 2.386s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Created reservations ['c267da78-6247-47e6-a50f-978a612e829b', 'fefe5812-a1de-4dc7-ab32-f357b5169737', 'c7ea575f-d46d-4b8d-bd28-8c5d511afe13', '73a2c99c-0e79-4cb8-808e-74dc6d3d4e77'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:35 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:56:35 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:35 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef 1G" returned: 0 in 1.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:35 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef
Sep 12 20:56:35 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:35 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.411s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:35 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:56:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Deleted volume successfully.
Sep 12 20:56:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a3faf9e-d435-49a1-a866-04c58a7f4342 tempest-ServerRescueNegativeTestJSON-316055884 None] Lock "cinder-9b527484-7f41-4c2b-b6fc-d6c07f782af6-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:36 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef" returned: 0 in 0.653s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:36 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:56:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:36 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef
Sep 12 20:56:36 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:36 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef" returned: 0 in 0.522s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:37 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=63,cinder:UPDATE=71,cinder:INSERT=19,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:56:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:37 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info
Sep 12 20:56:37 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:37 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info" returned: 0 in 0.811s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:37 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:56:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:37 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info
Sep 12 20:56:37 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:38 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.info" returned: 0 in 0.680s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:38 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=76,cinder:UPDATE=57,cinder:DELETE=6,cinder:INSERT=8 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:56:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2e3e5282-9a77-445f-9f9c-e36f858c1628 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 1082be9b-08bb-4006-8801-7ccf98da813d: created successfully
Sep 12 20:56:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 1082be9b-08bb-4006-8801-7ccf98da813d: deleting
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 1082be9b-08bb-4006-8801-7ccf98da813d: deleting {{(pid=87624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-6916c632-308c-4744-903c-8792a71d730c" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-6916c632-308c-4744-903c-8792a71d730c" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-855e9fef-7e43-49e9-ac47-f5b66ff41659" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-855e9fef-7e43-49e9-ac47-f5b66ff41659" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Deleting offline snapshot 855e9fef-7e43-49e9-ac47-f5b66ff41659 of volume 6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] snapshot_file for this snap is: volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e2d784-f6aa-4d2b-b7b2-e1bc191b9fbf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:40 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659
Sep 12 20:56:40 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:41 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659" returned: 0 in 0.773s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6916c632-308c-4744-903c-8792a71d730c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 20:56:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b130341c-5f41-4f6f-9ca2-41670dfb3553]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:41 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c
Sep 12 20:56:41 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:42 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c" returned: 0 in 0.765s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:42 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659
Sep 12 20:56:42 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:42 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659" returned: 0 in 0.789s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:42 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659
Sep 12 20:56:42 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:43 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c.855e9fef-7e43-49e9-ac47-f5b66ff41659" returned: 0 in 0.460s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-855e9fef-7e43-49e9-ac47-f5b66ff41659" released by "_delete_snapshot" :: held 3.092s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-6916c632-308c-4744-903c-8792a71d730c" released by "delete_snapshot" :: held 3.139s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-faa215e6-1c2d-4d29-96b8-7aa785c980ef" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-faa215e6-1c2d-4d29-96b8-7aa785c980ef" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Deleting offline snapshot faa215e6-1c2d-4d29-96b8-7aa785c980ef of volume f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] snapshot_file for this snap is: volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe9685-af2f-4541-a7a5-07c3975ea3da]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:44 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef
Sep 12 20:56:44 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:44 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef" returned: 0 in 0.966s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 20:56:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6631cde5-3b65-400c-afe9-b7a43b226212]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:45 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f
Sep 12 20:56:45 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:45 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" returned: 0 in 0.612s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:45 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef
Sep 12 20:56:45 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:46 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef" returned: 0 in 0.634s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:46 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef
Sep 12 20:56:46 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:46 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f.faa215e6-1c2d-4d29-96b8-7aa785c980ef" returned: 0 in 0.475s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-faa215e6-1c2d-4d29-96b8-7aa785c980ef" released by "_delete_snapshot" :: held 3.029s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" released by "delete_snapshot" :: held 3.102s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:46 devstack cinder-volume[87624]: WARNING cinder.quota [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-658031648 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-658031648, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:56:46 devstack cinder-volume[87624]: WARNING cinder.quota [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-658031648 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-658031648, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:56:46 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Created reservations ['bb54fb02-94a4-4fde-b6be-7ccd10a064d1', '00e8bb05-1c12-4464-8134-947efad5f782', '5b552702-18c2-40ee-9d84-833b6c1ae1c6', 'c56f7787-cf8f-43b7-aef9-e3363e208bc3'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:47 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] Created reservations ['41937d1c-56c9-4576-86b9-a7fee3a05fd8', '8fa8ea3b-b3ee-45ad-8e82-a4d97417c25a', 'e86651a9-29fb-47ff-8c4c-d8c970fbea91', '670fd736-09c6-4c51-909c-063ff4894da2'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-77a48c17-420b-4626-8d4d-01e6bda72ed8 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 1082be9b-08bb-4006-8801-7ccf98da813d: deleted successfully
Sep 12 20:56:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-6916c632-308c-4744-903c-8792a71d730c" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-6916c632-308c-4744-903c-8792a71d730c" acquired by "delete_volume" :: waited 0.042s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f2dc4b-8d59-47f6-a414-1ec26c19d2fb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:49 devstack sudo[90801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c
Sep 12 20:56:49 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:49 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c" returned: 0 in 0.650s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:49 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c
Sep 12 20:56:49 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:50 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6916c632-308c-4744-903c-8792a71d730c" returned: 0 in 0.337s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-6916c632-308c-4744-903c-8792a71d730c" released by "delete_volume" :: held 1.163s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" acquired by "delete_volume" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b963b79-e0dc-4987-a97c-a9eb186df163]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:50 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f
Sep 12 20:56:50 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:50 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" returned: 0 in 0.495s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:50 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f
Sep 12 20:56:50 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:51 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" returned: 0 in 0.410s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-f9e3b384-304b-49b8-a99f-e78ccef3dc5f" released by "delete_volume" :: held 1.009s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Created reservations ['31524816-ed24-4581-b8df-57fddf119628'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:51 devstack cinder-volume[87624]: WARNING cinder.quota [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-658031648 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-658031648, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Created reservations ['864cb4ee-1738-4cec-90be-01ed861491a8', '238721f6-fe35-4b65-b5d6-4364e7c10922', 'b3cfa1b0-a54a-4a26-a04a-490f6cb8e32d', 'b3098f7c-14e3-45ac-9e1d-2230f0e9b061'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Created reservations ['dfe43716-a1f9-444b-a73a-a53b651c0498', 'ae857c0b-7de6-49e4-adcc-db432526149b', '597943a8-7618-4999-9cba-52926c444b12', '3b749289-290c-4b8e-9d9b-d888120e96b5'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:51 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:56:51 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:52 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.386s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:52 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:56:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d2d9156e-faba-4c9e-a311-6d7a97a34aeb tempest-GroupSnapshotsTest-125817033 None] Delete group completed successfully.
Sep 12 20:56:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4a61b734-0930-46e6-8fee-8645a0630317 tempest-GroupSnapshotsTest-125817033 None] Group tempest-GroupSnapshotsTest-Group-833443942: creating
Sep 12 20:56:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4a61b734-0930-46e6-8fee-8645a0630317 tempest-GroupSnapshotsTest-125817033 None] Group tempest-GroupSnapshotsTest-Group-833443942: created successfully
Sep 12 20:56:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4a61b734-0930-46e6-8fee-8645a0630317 tempest-GroupSnapshotsTest-125817033 None] Create group completed successfully.
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (f2099313-709d-4cf8-a9dc-5574c6d364d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851b0326-b696-4cd5-8e68-0cee5a2d65bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851b0326-b696-4cd5-8e68-0cee5a2d65bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495711887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59e65dbc-5f19-40ab-9484-bc2fcf73ba14,host='devstack@QuobyteHD#QuobyteHD',id=82634322-0a24-41ed-8e6f-9f5c390b5129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:55Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6e697f3-6565-469c-91c2-e8ac52faa919),volume_type_id=b6e697f3-6565-469c-91c2-e8ac52faa919)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92411fc6-25c1-4ed7-ad9f-d9da91b9cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92411fc6-25c1-4ed7-ad9f-d9da91b9cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edef4b63-260c-4233-88bc-6d23a64f1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edef4b63-260c-4233-88bc-6d23a64f1581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82634322-0a24-41ed-8e6f-9f5c390b5129', 'volume_name': 'volume-82634322-0a24-41ed-8e6f-9f5c390b5129', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0348bc67-24c0-4b92-8e24-0b4bffdd6ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0348bc67-24c0-4b92-8e24-0b4bffdd6ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35d1d7e-1454-4d66-a1fb-3c4fe79c30c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Volume 82634322-0a24-41ed-8e6f-9f5c390b5129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82634322-0a24-41ed-8e6f-9f5c390b5129', 'volume_size': 1}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=59e65dbc-5f19-40ab-9484-bc2fcf73ba14,created_at=2026-09-12T18:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495711887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59e65dbc-5f19-40ab-9484-bc2fcf73ba14,host='devstack@QuobyteHD#QuobyteHD',id=82634322-0a24-41ed-8e6f-9f5c390b5129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c4a6581d1b4392b0bff7178a169618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:56:55Z,use_quota=True,user_id='ac97c11ce275432fbc2db4344dd096e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6e697f3-6565-469c-91c2-e8ac52faa919),volume_type_id=b6e697f3-6565-469c-91c2-e8ac52faa919)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Creating volume 82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:56:55 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:56:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:55 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 1073741824
Sep 12 20:56:55 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:56 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 1073741824" returned: 0 in 0.527s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:56 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129
Sep 12 20:56:56 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:56 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129" returned: 0 in 0.305s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35d1d7e-1454-4d66-a1fb-3c4fe79c30c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82634322-0a24-41ed-8e6f-9f5c390b5129', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf9e981-48c2-4ee9-a384-a782a39fd7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:56:56 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Volume volume-82634322-0a24-41ed-8e6f-9f5c390b5129 (82634322-0a24-41ed-8e6f-9f5c390b5129): created successfully
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf9e981-48c2-4ee9-a384-a782a39fd7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:56:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Flow 'volume_create_manager' (f2099313-709d-4cf8-a9dc-5574c6d364d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:56:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-956e20da-9423-4f98-a840-2054d86ced89 tempest-GroupSnapshotsTest-125817033 None] Created volume successfully.
Sep 12 20:56:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] GroupSnapshot 11858a7b-221a-4024-b939-00e62e01ddb0: creating.
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Group snapshot 11858a7b-221a-4024-b939-00e62e01ddb0: creating. {{(pid=87624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Creating offline snapshot 41485cb1-8d2f-453e-b63f-02a6e07fbb4f of volume 82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502ae54-5181-454f-b481-480e2d71007b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:57 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129
Sep 12 20:56:57 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:57 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129" returned: 0 in 0.497s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:57 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f 1G
Sep 12 20:56:57 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:58 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f 1G" returned: 0 in 0.483s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82634322-0a24-41ed-8e6f-9f5c390b5129 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:58 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82634322-0a24-41ed-8e6f-9f5c390b5129 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f
Sep 12 20:56:58 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:58 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82634322-0a24-41ed-8e6f-9f5c390b5129 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:58 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:58 devstack sudo[90929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f
Sep 12 20:56:58 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:58 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f" returned: 0 in 0.289s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:58 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info
Sep 12 20:56:58 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:58 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info" returned: 0 in 0.267s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:58 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 20:56:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:56:59 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info
Sep 12 20:56:59 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:56:59 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Sep 12 20:56:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.info" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:56:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:56:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4a0e824d-2ea8-4c50-b365-94216fb8f298 tempest-GroupSnapshotsTest-125817033 None] group_snapshot 11858a7b-221a-4024-b939-00e62e01ddb0: created successfully
Sep 12 20:57:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] group_snapshot 11858a7b-221a-4024-b939-00e62e01ddb0: deleting
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] group_snapshot 11858a7b-221a-4024-b939-00e62e01ddb0: deleting {{(pid=87624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-82634322-0a24-41ed-8e6f-9f5c390b5129" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-82634322-0a24-41ed-8e6f-9f5c390b5129" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-41485cb1-8d2f-453e-b63f-02a6e07fbb4f" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-41485cb1-8d2f-453e-b63f-02a6e07fbb4f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Deleting offline snapshot 41485cb1-8d2f-453e-b63f-02a6e07fbb4f of volume 82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] snapshot_file for this snap is: volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a16f474-4d20-4f5e-aff8-a518ada38aa7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:00 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f
Sep 12 20:57:00 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:01 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f" returned: 0 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82634322-0a24-41ed-8e6f-9f5c390b5129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f29a36-a676-46f1-a6bc-56a83c56eef6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:01 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129
Sep 12 20:57:01 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:01 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129" returned: 0 in 0.383s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:01 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f
Sep 12 20:57:01 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:01 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f" returned: 0 in 0.371s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:01 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f
Sep 12 20:57:01 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:02 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129.41485cb1-8d2f-453e-b63f-02a6e07fbb4f" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-41485cb1-8d2f-453e-b63f-02a6e07fbb4f" released by "_delete_snapshot" :: held 1.591s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-82634322-0a24-41ed-8e6f-9f5c390b5129" released by "delete_snapshot" :: held 1.623s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:02 devstack cinder-volume[87624]: WARNING cinder.quota [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2075943086 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2075943086, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:57:02 devstack cinder-volume[87624]: WARNING cinder.quota [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2075943086 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2075943086, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:57:02 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] Created reservations ['c5983598-7213-4302-bc65-8f43a0a085ba', '384a05fe-ff42-4be1-a144-04029f23626f', 'e14a2109-9313-47df-92eb-776c067e3c57', '7d26183e-ed86-4033-91c6-ce93dbe20239'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:57:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-914f19a2-b383-46bd-ab45-384d4ebab62e tempest-GroupSnapshotsTest-125817033 None] group_snapshot 11858a7b-221a-4024-b939-00e62e01ddb0: deleted successfully
Sep 12 20:57:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "cinder-quobyte-82634322-0a24-41ed-8e6f-9f5c390b5129" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-82634322-0a24-41ed-8e6f-9f5c390b5129" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c82530-3205-4463-b250-07111412af45]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:03 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129
Sep 12 20:57:03 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:04 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129" returned: 0 in 0.605s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:04 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129
Sep 12 20:57:04 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:04 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-82634322-0a24-41ed-8e6f-9f5c390b5129" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Lock "cinder-quobyte-82634322-0a24-41ed-8e6f-9f5c390b5129" released by "delete_volume" :: held 1.077s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Created reservations ['31e1e417-9442-45f9-8c31-29904a03ef26'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:57:04 devstack cinder-volume[87624]: WARNING cinder.quota [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2075943086 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2075943086, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Created reservations ['4324d7d3-8889-4477-8b4b-11d57054dd2b', 'f0ec1d45-94dd-42dd-821e-c86515919450', '6ea34529-9792-4c13-b3ba-05ec0555b1fd', 'c1128761-e187-49b9-931d-0f8ce8349389'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60109e5-6acd-4850-b518-27e178719083]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:04 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537
Sep 12 20:57:04 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:04 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:57:04 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:05 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.437s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-f57a76d1-5b7d-420c-8490-039d3d927537', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c97e4e6-5764-4df2-b17d-937de6acb2d8', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:57:05 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.331s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:05 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:57:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8d75e89c-3928-4d86-9e70-4cefc47f2695 tempest-GroupSnapshotsTest-125817033 None] Delete group completed successfully.
Sep 12 20:57:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-3b5b8505-7101-4b29-82d3-024cd92f28bf req-a2b81c30-34f7-4336-8b02-79715b7df183 tempest-ServerActionsTestOtherA-1572891832 None] attachment_update completed successfully.
Sep 12 20:57:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-8f6985d9-ad4c-4fef-a04c-9bbd398b34f0 tempest-ServerActionsTestOtherA-1572891832 None] Terminate volume connection completed successfully.
Sep 12 20:57:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-8f6985d9-ad4c-4fef-a04c-9bbd398b34f0 tempest-ServerActionsTestOtherA-1572891832 None] Deleting attachment 8c97e4e6-5764-4df2-b17d-937de6acb2d8. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:57:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea2e8d-47d4-4692-89a3-0abf29b5b98d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:10 devstack sudo[91448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537
Sep 12 20:57:10 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:10 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537" returned: 0 in 0.500s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.540s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-f57a76d1-5b7d-420c-8490-039d3d927537', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baa655af-30f9-40f1-8c07-94d166f484f4', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:57:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-3f0eaf69-6367-4f19-a3dc-8596754f89d3 req-77fb5f7d-6534-4f9d-8282-3ebeb15240aa tempest-ServerActionsTestOtherA-1572891832 None] attachment_update completed successfully.
Sep 12 20:57:20 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=73,cinder:UPDATE=55,cinder:INSERT=16,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:57:20 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=64,cinder:SELECT=60,cinder:INSERT=12 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:57:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bfea1e-fc2b-4f7f-a45e-ae564140f0ad]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:24 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed
Sep 12 20:57:24 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:25 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed" returned: 0 in 0.988s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.070s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-37c3494e-829c-4ad3-a975-2d1a024840ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c8073cc-7b7b-4e9e-95fd-1459714973b0', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:57:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-733fd253-5412-4241-8840-f7ef1f58aad8 req-7deaf614-37f6-4745-98cd-637a5145dd08 tempest-TaggedAttachmentsTest-43408903 None] attachment_update completed successfully.
Sep 12 20:57:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-a2f6f416-dd62-4316-b111-18881f3a4390 req-3006e825-3c06-479b-8496-e29fdb0ebd4c tempest-TaggedAttachmentsTest-43408903 None] Terminate volume connection completed successfully.
Sep 12 20:57:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a2f6f416-dd62-4316-b111-18881f3a4390 req-3006e825-3c06-479b-8496-e29fdb0ebd4c tempest-TaggedAttachmentsTest-43408903 None] Deleting attachment 8c8073cc-7b7b-4e9e-95fd-1459714973b0. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:33 devstack sudo[92159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:57:33 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:33 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.332s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:57:36 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Flow 'volume_create_manager' (297556f2-f12c-4707-afe4-96ee94cb9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a8e48e-ebcc-4324-abfd-8b7217879858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a8e48e-ebcc-4324-abfd-8b7217879858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-796862584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913015a0-7ada-41c6-b924-9d1d7d0e5fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27b5071b46646b69454ae3b62f15661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:57:37Z,use_quota=True,user_id='af67fb14ebfd45cca7a4040142710057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cd8168b-1425-48b3-ba4f-626963cf6161),volume_type_id=6cd8168b-1425-48b3-ba4f-626963cf6161)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02dfc8d-6d93-4ecc-8d24-272a3c6af267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02dfc8d-6d93-4ecc-8d24-272a3c6af267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66665434-844c-456c-9e1c-821489a396d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66665434-844c-456c-9e1c-821489a396d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '913015a0-7ada-41c6-b924-9d1d7d0e5fce', 'volume_name': 'volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac723fa-ef89-491b-b97d-75db1e0eb623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac723fa-ef89-491b-b97d-75db1e0eb623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0dc798-416e-485d-8a3d-3ebcd660068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:37 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Volume 913015a0-7ada-41c6-b924-9d1d7d0e5fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce', 'volume_size': 1}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-796862584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913015a0-7ada-41c6-b924-9d1d7d0e5fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27b5071b46646b69454ae3b62f15661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:57:37Z,use_quota=True,user_id='af67fb14ebfd45cca7a4040142710057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cd8168b-1425-48b3-ba4f-626963cf6161),volume_type_id=6cd8168b-1425-48b3-ba4f-626963cf6161)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Creating volume 913015a0-7ada-41c6-b924-9d1d7d0e5fce {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:57:37 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:37 devstack sudo[92188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce 1073741824
Sep 12 20:57:37 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:37 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce 1073741824" returned: 0 in 0.672s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:37 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce
Sep 12 20:57:37 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:38 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce" returned: 0 in 0.386s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0dc798-416e-485d-8a3d-3ebcd660068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06da93d0-386f-4067-921e-5d24ba7a8ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:38 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Volume volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce (913015a0-7ada-41c6-b924-9d1d7d0e5fce): created successfully
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06da93d0-386f-4067-921e-5d24ba7a8ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Flow 'volume_create_manager' (297556f2-f12c-4707-afe4-96ee94cb9e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:57:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-fb127d5b-712f-481d-896d-bae7445b1c1f tempest-VolumeTypesAccessTest-2041248066 None] Created volume successfully.
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Acquiring lock "cinder-913015a0-7ada-41c6-b924-9d1d7d0e5fce-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Lock "cinder-913015a0-7ada-41c6-b924-9d1d7d0e5fce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Acquiring lock "cinder-quobyte-913015a0-7ada-41c6-b924-9d1d7d0e5fce" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Lock "cinder-quobyte-913015a0-7ada-41c6-b924-9d1d7d0e5fce" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a682c343-7059-42b6-bb6c-6624274e322c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-21a21ede-8905-4695-a9ed-fe94de81d0ed req-6845e930-0b8c-42c6-b11d-3b7a148279cb tempest-ServerActionsTestOtherA-1572891832 None] Terminate volume connection completed successfully.
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-21a21ede-8905-4695-a9ed-fe94de81d0ed req-6845e930-0b8c-42c6-b11d-3b7a148279cb tempest-ServerActionsTestOtherA-1572891832 None] Deleting attachment baa655af-30f9-40f1-8c07-94d166f484f4. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:57:39 devstack sudo[92206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce
Sep 12 20:57:39 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:39 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce" returned: 0 in 0.520s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:39 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce
Sep 12 20:57:39 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:40 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-913015a0-7ada-41c6-b924-9d1d7d0e5fce" returned: 0 in 0.340s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Lock "cinder-quobyte-913015a0-7ada-41c6-b924-9d1d7d0e5fce" released by "delete_volume" :: held 0.924s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:40 devstack cinder-volume[87624]: WARNING cinder.quota [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2135459475 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2135459475, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:57:40 devstack cinder-volume[87624]: WARNING cinder.quota [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2135459475 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2135459475, it is now deprecated. Please use the default quota class for default quota.
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Created reservations ['49443598-3ea2-4e5e-b213-ef074123458d', '260387f0-13e0-4326-a9cf-9d26e4b18d5f', '25e55136-a86a-4602-afc1-d89d9011eb85', 'bfe128a9-f442-40b9-97f5-fd3dff974e73'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:40 devstack sudo[92218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:57:40 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:40 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.525s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:57:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Deleted volume successfully.
Sep 12 20:57:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-650efba7-0f11-4699-91fe-a6376ecc485b tempest-VolumeTypesAccessTest-2041248066 None] Lock "cinder-913015a0-7ada-41c6-b924-9d1d7d0e5fce-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Acquiring lock "cinder-37c3494e-829c-4ad3-a975-2d1a024840ed-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Lock "cinder-37c3494e-829c-4ad3-a975-2d1a024840ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Acquiring lock "cinder-quobyte-37c3494e-829c-4ad3-a975-2d1a024840ed" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Lock "cinder-quobyte-37c3494e-829c-4ad3-a975-2d1a024840ed" acquired by "delete_volume" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[987e43d9-6c0c-4a8c-a363-fb49e40b06b6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:42 devstack sudo[92273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed
Sep 12 20:57:42 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:42 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed" returned: 0 in 0.422s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:42 devstack sudo[92279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed
Sep 12 20:57:42 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:42 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-37c3494e-829c-4ad3-a975-2d1a024840ed" returned: 0 in 0.287s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Lock "cinder-quobyte-37c3494e-829c-4ad3-a975-2d1a024840ed" released by "delete_volume" :: held 0.761s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Created reservations ['ab442607-6fb7-4c63-85bd-25fd3a927c25', '7d674141-667a-4ff6-9e21-52257ec29e97', '53bb6c01-8237-48d6-a7be-3688beaad547', '49f329b9-388d-4f7b-aac7-d97a56bd1b79'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:43 devstack sudo[92282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:57:43 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:43 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.277s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:57:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Deleted volume successfully.
Sep 12 20:57:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-607e4f77-549a-4604-b5df-04f4397b5943 tempest-TaggedAttachmentsTest-43408903 None] Lock "cinder-37c3494e-829c-4ad3-a975-2d1a024840ed-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Flow 'volume_create_manager' (52c95298-6e23-46e7-a733-066814d5a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e60b741-f7bd-4144-99b8-88d3b728c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e60b741-f7bd-4144-99b8-88d3b728c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-750370324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e167ebd-e1a1-4c74-81e8-1f92b385120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d42a240e6b4fd89856ed68b312e8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:57:47Z,use_quota=True,user_id='45c9aee36fe242a3936c247a28f6228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eabbd2a-1cda-4543-ba2a-bee0fa0b4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eabbd2a-1cda-4543-ba2a-bee0fa0b4386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f5f7d0-3efa-4ca6-acec-e3d901c3c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:46 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 20:57:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f5f7d0-3efa-4ca6-acec-e3d901c3c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e167ebd-e1a1-4c74-81e8-1f92b385120e', 'volume_name': 'volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056f270e0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fa6336-0cc2-4519-9685-be2a1d3b4067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fa6336-0cc2-4519-9685-be2a1d3b4067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9c6cdd-3e5a-4fc8-a60e-a15ab4474359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:47 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Volume 8e167ebd-e1a1-4c74-81e8-1f92b385120e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056f270e0>}
Sep 12 20:57:47 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Trying to clone 8e167ebd-e1a1-4c74-81e8-1f92b385120e from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 20:57:48 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Image download 20.69 MB at 20.69 MB/s
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3274af13-9bef-4cd4-92c3-34b846762204]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:48 devstack sudo[92308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD
Sep 12 20:57:48 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:48 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 is fetched for user 45c9aee36fe242a3936c247a28f6228c. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[963afb3c-6d06-4387-bca6-8ac7e18dcc44]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:49 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD
Sep 12 20:57:49 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:49 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-750370324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e167ebd-e1a1-4c74-81e8-1f92b385120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d42a240e6b4fd89856ed68b312e8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:57:47Z,use_quota=True,user_id='45c9aee36fe242a3936c247a28f6228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Creating volume 8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:57:49 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:57:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:49 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e 1073741824
Sep 12 20:57:49 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:50 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e 1073741824" returned: 0 in 0.658s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:50 devstack sudo[92333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:57:50 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:50 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 0.374s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Attempting download of 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume 8e167ebd-e1a1-4c74-81e8-1f92b385120e. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a8adc5-0293-481b-8392-2cc1c1ccd460]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:50 devstack sudo[92345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb
Sep 12 20:57:50 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Flow 'volume_create_manager' (4854f30c-2d76-498f-8b07-7de0cf87d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc1c5d6-23dc-45fb-bfaa-21c92a2aac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc1c5d6-23dc-45fb-bfaa-21c92a2aac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1097817407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085e3be4-07c7-48e8-b7d2-53f890b7b731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5d5738778640479b52c3d2db30aaea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:57:51Z,use_quota=True,user_id='72d9de9bd4d441dc9f9904bcee2da54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec6fd1d-72ad-4192-8bf0-da107b8a3211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec6fd1d-72ad-4192-8bf0-da107b8a3211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b87eee-3647-4a24-944f-efe5fcca30b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b87eee-3647-4a24-944f-efe5fcca30b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085e3be4-07c7-48e8-b7d2-53f890b7b731', 'volume_name': 'volume-085e3be4-07c7-48e8-b7d2-53f890b7b731', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7807eb-d8af-4a65-b639-76bea0b685a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7807eb-d8af-4a65-b639-76bea0b685a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583d227-bd87-410b-aa5b-400fb5f0d93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Volume 085e3be4-07c7-48e8-b7d2-53f890b7b731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085e3be4-07c7-48e8-b7d2-53f890b7b731', 'volume_size': 1}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1097817407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085e3be4-07c7-48e8-b7d2-53f890b7b731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5d5738778640479b52c3d2db30aaea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:57:51Z,use_quota=True,user_id='72d9de9bd4d441dc9f9904bcee2da54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Creating volume 085e3be4-07c7-48e8-b7d2-53f890b7b731 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:57:51 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:51 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:51 devstack sudo[92351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 1073741824
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb" returned: 0 in 0.648s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:51 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:51 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb
Sep 12 20:57:51 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:51 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb" returned: 1 in 0.375s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_yyje0crb' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[50946238-13e0-4048-8133-7e8c2f46613a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:51 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 1073741824" returned: 0 in 0.534s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:51 devstack sudo[92363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD
Sep 12 20:57:51 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:51 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731
Sep 12 20:57:51 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:52 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 was qcow2, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 20:57:52 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731" returned: 0 in 0.311s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583d227-bd87-410b-aa5b-400fb5f0d93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085e3be4-07c7-48e8-b7d2-53f890b7b731', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be689f6-7bb5-4964-b412-6a2d596cbedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Volume volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 (085e3be4-07c7-48e8-b7d2-53f890b7b731): created successfully
Sep 12 20:57:52 devstack sudo[92371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:57:52 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be689f6-7bb5-4964-b412-6a2d596cbedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Flow 'volume_create_manager' (4854f30c-2d76-498f-8b07-7de0cf87d465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:57:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a79e9651-4ba8-4aa4-b915-3a4dc8efc3b4 tempest-AttachVolumeShelveTestJSON-1528329681 None] Created volume successfully.
Sep 12 20:57:54 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 2.141s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:54 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_23wm07etdevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 20:57:54 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Converted 112.00 MB image at 52.29 MB/s
Sep 12 20:57:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:54 devstack sudo[92421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e 1G
Sep 12 20:57:54 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:54 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e 1G" returned: 0 in 0.404s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc602b-252d-4b19-948b-2929c9eb4965]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:57:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:54 devstack sudo[92426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:57:54 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:55 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 0.532s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:57:55 devstack sudo[92435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:57:55 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:57:55 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 1 in 0.463s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Downloaded image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume 8e167ebd-e1a1-4c74-81e8-1f92b385120e successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 for user 45c9aee36fe242a3936c247a28f6228c is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Marking volume 8e167ebd-e1a1-4c74-81e8-1f92b385120e as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Copying metadata from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 to 8e167ebd-e1a1-4c74-81e8-1f92b385120e. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Creating volume glance metadata for volume 8e167ebd-e1a1-4c74-81e8-1f92b385120e backed by image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9c6cdd-3e5a-4fc8-a60e-a15ab4474359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056f270e0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b376671f-c97b-4f5b-87c3-eb6756218e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:57:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Volume volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e (8e167ebd-e1a1-4c74-81e8-1f92b385120e): created successfully
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b376671f-c97b-4f5b-87c3-eb6756218e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:57:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Flow 'volume_create_manager' (52c95298-6e23-46e7-a733-066814d5a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:57:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bbb50a07-ca40-4b35-bbb0-1ff2540daaeb tempest-ServerActionsTestOtherA-1572891832 None] Created volume successfully.
Sep 12 20:58:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a41fb-be53-4323-95a4-921edb94e987]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:58:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:00 devstack sudo[92465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:00 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:00 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 0.391s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:00 devstack sudo[92469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:00 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:01 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 1 in 0.390s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 20:58:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31182c1b-866a-4930-bb68-350d7dfd65a8', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:58:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-8ba32491-fde3-4589-8a2f-d7925dd2e650 req-df5aaa8f-a05c-474f-ac16-a92dc6175351 tempest-ServerActionsTestOtherA-1572891832 None] attachment_update completed successfully.
Sep 12 20:58:11 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=37,cinder:UPDATE=29,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:58:11 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=37,cinder:UPDATE=31,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:58:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-d725ab02-a267-4b7f-8239-2ef6e437f37d req-e0a558f6-696b-4a7e-86bb-a064cd747f83 tempest-AttachVolumeShelveTestJSON-1528329681 None] No connector for attachment 527db387-7a79-4fff-814c-c22f94bf71f3; skipping storage backend terminate_connection call. {{(pid=87624) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 12 20:58:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-d725ab02-a267-4b7f-8239-2ef6e437f37d req-e0a558f6-696b-4a7e-86bb-a064cd747f83 tempest-AttachVolumeShelveTestJSON-1528329681 None] Deleting attachment 527db387-7a79-4fff-814c-c22f94bf71f3. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:58:28 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:58:28 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:33 devstack sudo[93140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:58:33 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:34 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.880s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:34 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:58:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-52f20290-da61-471b-ae88-635639814cb5 tempest-ServerActionsTestOtherA-1572891832 None] Terminate volume connection completed successfully.
Sep 12 20:58:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-52f20290-da61-471b-ae88-635639814cb5 tempest-ServerActionsTestOtherA-1572891832 None] Deleting attachment 31182c1b-866a-4930-bb68-350d7dfd65a8. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:58:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:42 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aee058d-80d9-4465-aa74-fd3960c3a09c]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:58:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:43 devstack sudo[93266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:43 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:43 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 1.227s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:44 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:44 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:44 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 1 in 0.528s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 20:58:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.896s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c3af1c4-ed0e-449c-807f-18d94e26935b', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:58:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-6cc115f3-e97a-41c9-8cf9-7cdcda4bfacc req-0762c673-2967-4e3c-82f9-4bd4f2a17ef9 tempest-ServerActionsTestOtherA-1572891832 None] attachment_update completed successfully.
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (bd2b35c0-91d2-41cb-abc6-54c0ec7d5fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21006db0-9eba-4009-979d-4feadd0d645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21006db0-9eba-4009-979d-4feadd0d645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1214732842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770abfb0-ffd9-4825-94bb-369b8ccf6c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:58:51Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61377ff4-457f-4def-a1de-8b3d75ac62da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61377ff4-457f-4def-a1de-8b3d75ac62da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a4d5a8-a4dd-4042-955a-46b36e86cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a4d5a8-a4dd-4042-955a-46b36e86cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770abfb0-ffd9-4825-94bb-369b8ccf6c71', 'volume_name': 'volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8faa60-c7b7-4401-b5ac-84c115143b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8faa60-c7b7-4401-b5ac-84c115143b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182532b2-522f-4789-82e4-7e22f79193c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:50 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Volume 770abfb0-ffd9-4825-94bb-369b8ccf6c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71', 'volume_size': 1}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1214732842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770abfb0-ffd9-4825-94bb-369b8ccf6c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:58:51Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Creating volume 770abfb0-ffd9-4825-94bb-369b8ccf6c71 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:58:50 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:58:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:51 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 1073741824
Sep 12 20:58:51 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:51 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 1073741824" returned: 0 in 0.989s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:52 devstack sudo[93896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71
Sep 12 20:58:52 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:52 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71" returned: 0 in 0.594s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182532b2-522f-4789-82e4-7e22f79193c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e967154e-3ead-4ecc-814e-4f53cbd09b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Volume volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 (770abfb0-ffd9-4825-94bb-369b8ccf6c71): created successfully
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e967154e-3ead-4ecc-814e-4f53cbd09b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (bd2b35c0-91d2-41cb-abc6-54c0ec7d5fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:58:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-416c69d9-b3d0-412a-8f0c-3cb65f0bd119 tempest-VolumesActionsTest-1326121589 None] Created volume successfully.
Sep 12 20:58:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0a862267-e7ad-4874-b97c-bf4aa5a137b1 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71" by "attach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0a862267-e7ad-4874-b97c-bf4aa5a137b1 tempest-VolumesActionsTest-1326121589 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71" acquired by "attach_volume" :: waited 0.091s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0a862267-e7ad-4874-b97c-bf4aa5a137b1 tempest-VolumesActionsTest-1326121589 None] Attaching volume 770abfb0-ffd9-4825-94bb-369b8ccf6c71 to instance dcf337ad-ab4e-44e0-83b9-a95154f8be58 at mountpoint /dev/vdb on host None.
Sep 12 20:58:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0a862267-e7ad-4874-b97c-bf4aa5a137b1 tempest-VolumesActionsTest-1326121589 None] Attach volume completed successfully.
Sep 12 20:58:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-4f1b1bf4-999d-42ee-9b09-03a4cfe03fda tempest-ServerActionsTestOtherA-1572891832 None] Terminate volume connection completed successfully.
Sep 12 20:58:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-4f1b1bf4-999d-42ee-9b09-03a4cfe03fda tempest-ServerActionsTestOtherA-1572891832 None] Deleting attachment 2c3af1c4-ed0e-449c-807f-18d94e26935b. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:58:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0a862267-e7ad-4874-b97c-bf4aa5a137b1 tempest-VolumesActionsTest-1326121589 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71" released by "attach_volume" :: held 0.278s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "cinder-8e167ebd-e1a1-4c74-81e8-1f92b385120e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-8e167ebd-e1a1-4c74-81e8-1f92b385120e-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "cinder-quobyte-8e167ebd-e1a1-4c74-81e8-1f92b385120e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-quobyte-8e167ebd-e1a1-4c74-81e8-1f92b385120e" acquired by "delete_volume" :: waited 0.048s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de269b-c693-4509-864d-fbf29038cfa6]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:58:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:55 devstack sudo[93955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:55 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-360ada29-8a66-4288-b8dc-216b9f32c0e8 tempest-VolumesActionsTest-109355601 None] Terminate volume connection completed successfully.
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-360ada29-8a66-4288-b8dc-216b9f32c0e8 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-detach_volume" by "detach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-360ada29-8a66-4288-b8dc-216b9f32c0e8 tempest-VolumesActionsTest-109355601 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-360ada29-8a66-4288-b8dc-216b9f32c0e8 tempest-VolumesActionsTest-109355601 None] Detaching volume 770abfb0-ffd9-4825-94bb-369b8ccf6c71 from instance dcf337ad-ab4e-44e0-83b9-a95154f8be58.
Sep 12 20:58:56 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 1.061s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-360ada29-8a66-4288-b8dc-216b9f32c0e8 tempest-VolumesActionsTest-109355601 None] Detach volume completed successfully.
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-360ada29-8a66-4288-b8dc-216b9f32c0e8 tempest-VolumesActionsTest-109355601 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:56 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:56 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92b62b18-87b3-41c8-92d7-fe595dfed54b tempest-VolumesActionsTest-1326121589 None] Acquiring lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-detach_volume" by "detach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92b62b18-87b3-41c8-92d7-fe595dfed54b tempest-VolumesActionsTest-1326121589 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-92b62b18-87b3-41c8-92d7-fe595dfed54b tempest-VolumesActionsTest-1326121589 None] Volume detach called, but volume not attached.
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92b62b18-87b3-41c8-92d7-fe595dfed54b tempest-VolumesActionsTest-1326121589 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:56 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 1 in 0.615s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 20:58:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:56 devstack sudo[93964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e
Sep 12 20:58:56 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "cinder-quobyte-770abfb0-ffd9-4825-94bb-369b8ccf6c71" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Lock "cinder-quobyte-770abfb0-ffd9-4825-94bb-369b8ccf6c71" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a20257-94f9-4924-96f9-b4dc3814be88]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:57 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8e167ebd-e1a1-4c74-81e8-1f92b385120e" returned: 0 in 0.388s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "cinder-f57a76d1-5b7d-420c-8490-039d3d927537-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-quobyte-8e167ebd-e1a1-4c74-81e8-1f92b385120e" released by "delete_volume" :: held 2.191s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-f57a76d1-5b7d-420c-8490-039d3d927537-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "cinder-quobyte-f57a76d1-5b7d-420c-8490-039d3d927537" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:58:57 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71
Sep 12 20:58:57 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-quobyte-f57a76d1-5b7d-420c-8490-039d3d927537" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d975b5-bfd0-4cc0-b224-a50be157369d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.quota [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Created reservations ['39c1a265-4d6c-4089-a9f6-71104c35953e', '1a03bb9e-001c-4a5b-92cf-42d19a7c4e05', 'b265aa21-eee1-42d5-a84d-d0ce9e697de8', '06f923e7-50f4-473d-8f4f-cb735ef9adec'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:57 devstack sudo[93969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537
Sep 12 20:58:57 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:57 devstack sudo[93970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:58:57 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:57 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71" returned: 0 in 0.623s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:57 devstack sudo[93977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71
Sep 12 20:58:57 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:58 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:58 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537" returned: 0 in 0.574s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.manager [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:58:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Deleted volume successfully.
Sep 12 20:58:58 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537
Sep 12 20:58:58 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-0b1b15b2-4aa5-4fa2-918e-260ab87c40c8 req-cf4fe152-375e-4f5c-b223-fe53c1b0ec35 tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-8e167ebd-e1a1-4c74-81e8-1f92b385120e-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:58 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-770abfb0-ffd9-4825-94bb-369b8ccf6c71" returned: 0 in 0.406s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Lock "cinder-quobyte-770abfb0-ffd9-4825-94bb-369b8ccf6c71" released by "delete_volume" :: held 1.111s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Created reservations ['740f82b2-a219-47ce-894b-5d253371f1c2', 'dd7c8fee-f8ca-4eff-986f-2b64e26683f7', '4fc65f37-73e7-4da7-93b7-e0b9a5b32d86', 'b0e9efcb-814c-4ba3-9fff-3d48697a11d8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:58 devstack sudo[93992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:58:58 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f57a76d1-5b7d-420c-8490-039d3d927537" returned: 0 in 0.526s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:58 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-quobyte-f57a76d1-5b7d-420c-8490-039d3d927537" released by "delete_volume" :: held 1.177s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Created reservations ['3380be8f-0538-4da4-87a5-a286c0479fae', '963c447b-6813-4bc0-b516-ba8b2b13863f', 'eaf6d5e9-b16d-47c8-a8cc-d9bb1d5f54d3', 'd52c6112-23e7-40a9-bdda-807b9c39f0ee'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:58 devstack sudo[93995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:58:58 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:58:58 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.480s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:58:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Deleted volume successfully.
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd6f37ab-745b-4fea-bc85-0f0e89859964 tempest-VolumesActionsTest-1326121589 None] Lock "cinder-770abfb0-ffd9-4825-94bb-369b8ccf6c71-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:59 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.390s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:58:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Deleted volume successfully.
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d9ce59c9-5168-4536-b200-2e1f1624c34c tempest-ServerActionsTestOtherA-1572891832 None] Lock "cinder-f57a76d1-5b7d-420c-8490-039d3d927537-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Flow 'volume_create_manager' (d44c9b4a-a707-4678-acf5-dbaec28eae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d8f12b-40e9-49d3-84fd-978116458b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d8f12b-40e9-49d3-84fd-978116458b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1572855265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dd24c17807440584f86db404d79feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:58:59Z,use_quota=True,user_id='e8bbab724b854781a4fadddf2b022b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a003771a-a344-445a-bb45-0d7eb76eb787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a003771a-a344-445a-bb45-0d7eb76eb787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14cbfc1-7b92-4091-aef8-5b891f48ed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14cbfc1-7b92-4091-aef8-5b891f48ed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e', 'volume_name': 'volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e49f5d1-99b7-4306-a599-75c9d3cb5108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e49f5d1-99b7-4306-a599-75c9d3cb5108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f073be9-9cc1-4c07-8744-fa09669ea494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:58:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Volume a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e', 'volume_size': 1}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1572855265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dd24c17807440584f86db404d79feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:58:59Z,use_quota=True,user_id='e8bbab724b854781a4fadddf2b022b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Creating volume a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:58:59 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:58:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:58:59 devstack sudo[93998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e 1073741824
Sep 12 20:58:59 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:00 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e 1073741824" returned: 0 in 0.843s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:00 devstack sudo[94030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e
Sep 12 20:59:00 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:01 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" returned: 0 in 0.668s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f073be9-9cc1-4c07-8744-fa09669ea494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c579fd00-30d6-43b3-ac7e-bb5deb28df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:01 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Volume volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e (a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e): created successfully
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c579fd00-30d6-43b3-ac7e-bb5deb28df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Flow 'volume_create_manager' (d44c9b4a-a707-4678-acf5-dbaec28eae46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4ba76627-f0eb-420f-84e6-fc9fa38b735a tempest-AttachVolumeTestJSON-2142455472 None] Created volume successfully.
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093e0cf-9ef8-4dd1-abdd-c8d5697bc119]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:02 devstack sudo[94069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e
Sep 12 20:59:02 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:02 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.402s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec072c65-1e75-4061-807d-cf0e5a1a0069', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 20:59:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-c45f495a-59b1-464b-b4f3-f25d44e34f02 req-7750115b-99f4-4709-87b6-68d725ecf9c2 tempest-AttachVolumeTestJSON-2142455472 None] attachment_update completed successfully.
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (e7d0979e-9441-4c3c-bae2-b3cdf79127b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de293ad5-0b33-4461-be44-2f1f0ba7050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de293ad5-0b33-4461-be44-2f1f0ba7050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1656266569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5119b5d4-7138-4ca2-b476-90ffa19edaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:04Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c24e7fc-55c4-4912-a284-2fe3c61ebcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c24e7fc-55c4-4912-a284-2fe3c61ebcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aabc0f6-2efa-406d-aaab-ede9e6f87afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aabc0f6-2efa-406d-aaab-ede9e6f87afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5119b5d4-7138-4ca2-b476-90ffa19edaa6', 'volume_name': 'volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a888cf91-96fc-4941-b602-8574ae566f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a888cf91-96fc-4941-b602-8574ae566f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397588c3-416d-4ae0-b3f1-2ac7070f0657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Volume 5119b5d4-7138-4ca2-b476-90ffa19edaa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6', 'volume_size': 1}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1656266569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5119b5d4-7138-4ca2-b476-90ffa19edaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:04Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Creating volume 5119b5d4-7138-4ca2-b476-90ffa19edaa6 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:03 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:03 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 1073741824
Sep 12 20:59:03 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:04 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 1073741824" returned: 0 in 0.466s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:04 devstack sudo[94461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6
Sep 12 20:59:04 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:04 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6" returned: 0 in 0.275s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397588c3-416d-4ae0-b3f1-2ac7070f0657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b37e27-c514-494d-a26c-a35091042915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Volume volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 (5119b5d4-7138-4ca2-b476-90ffa19edaa6): created successfully
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b37e27-c514-494d-a26c-a35091042915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (e7d0979e-9441-4c3c-bae2-b3cdf79127b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-961a1970-c9f4-4bfb-a40f-25d1b12ee557 tempest-VolumesActionsTest-1326121589 None] Created volume successfully.
Sep 12 20:59:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-5119b5d4-7138-4ca2-b476-90ffa19edaa6-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Lock "cinder-5119b5d4-7138-4ca2-b476-90ffa19edaa6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-quobyte-5119b5d4-7138-4ca2-b476-90ffa19edaa6" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-5119b5d4-7138-4ca2-b476-90ffa19edaa6" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9700661b-1e58-4ec2-b892-2a33e75e793a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:06 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6
Sep 12 20:59:06 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:06 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6" returned: 0 in 0.377s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:06 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6
Sep 12 20:59:06 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:06 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5119b5d4-7138-4ca2-b476-90ffa19edaa6" returned: 0 in 0.289s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-5119b5d4-7138-4ca2-b476-90ffa19edaa6" released by "delete_volume" :: held 0.716s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Created reservations ['b87490f5-8997-43f2-b8a4-3873d067ba21', '43dcd8cb-29d5-4ef3-ae4a-f46acf4be49e', '6d101dac-e929-476f-ae31-84a0386dfa06', 'd880bd2d-e4a8-4ce2-878f-92d46823b8d6'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:06 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:06 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:07 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.340s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:07 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Deleted volume successfully.
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9efe96d1-82eb-42d2-8f2c-33d4aba41d68 tempest-VolumesActionsTest-109355601 None] Lock "cinder-5119b5d4-7138-4ca2-b476-90ffa19edaa6-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (23b92d50-af9e-4691-acf6-d229eab93074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d44176-9531-47b2-9ea0-757b36fc9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d44176-9531-47b2-9ea0-757b36fc9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-792804639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c28cf1-1c0f-4378-9dcb-f4649779da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:08Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26087e4c-f693-43dc-8b80-c17f92d4ff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26087e4c-f693-43dc-8b80-c17f92d4ff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77cd3f7-2be1-4357-be78-dbb838c5f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77cd3f7-2be1-4357-be78-dbb838c5f46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c28cf1-1c0f-4378-9dcb-f4649779da84', 'volume_name': 'volume-84c28cf1-1c0f-4378-9dcb-f4649779da84', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcafe6d2-a0e1-4c38-a0fb-0edf11752db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcafe6d2-a0e1-4c38-a0fb-0edf11752db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33895214-3254-4ad4-bf8e-23a0db8e6834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Volume 84c28cf1-1c0f-4378-9dcb-f4649779da84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c28cf1-1c0f-4378-9dcb-f4649779da84', 'volume_size': 1}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-792804639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c28cf1-1c0f-4378-9dcb-f4649779da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:08Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Creating volume 84c28cf1-1c0f-4378-9dcb-f4649779da84 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:08 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:08 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 1073741824
Sep 12 20:59:08 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:08 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 1073741824" returned: 0 in 0.743s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:08 devstack sudo[94603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84
Sep 12 20:59:08 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:09 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84" returned: 0 in 0.443s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33895214-3254-4ad4-bf8e-23a0db8e6834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c28cf1-1c0f-4378-9dcb-f4649779da84', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf972d08-5ecf-4708-87b8-e1adb3a91b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Volume volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 (84c28cf1-1c0f-4378-9dcb-f4649779da84): created successfully
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf972d08-5ecf-4708-87b8-e1adb3a91b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (23b92d50-af9e-4691-acf6-d229eab93074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-54b93b2b-7b67-4e82-8738-6ce5a63ac216 tempest-VolumesActionsTest-1326121589 None] Created volume successfully.
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-84c28cf1-1c0f-4378-9dcb-f4649779da84-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Lock "cinder-84c28cf1-1c0f-4378-9dcb-f4649779da84-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-quobyte-84c28cf1-1c0f-4378-9dcb-f4649779da84" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-84c28cf1-1c0f-4378-9dcb-f4649779da84" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfffdc83-65b9-473e-9671-b4836af4f8b3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:10 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84
Sep 12 20:59:10 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:10 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84" returned: 0 in 0.487s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:10 devstack sudo[94994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84
Sep 12 20:59:10 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:11 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-84c28cf1-1c0f-4378-9dcb-f4649779da84" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-84c28cf1-1c0f-4378-9dcb-f4649779da84" released by "delete_volume" :: held 0.956s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Created reservations ['545ff830-b2e1-4ab6-aa18-334ab675c521', '2dbd458f-04fc-41de-ba26-e46db353aacb', 'd2e5329f-b3ba-4350-a457-f4ce4fac8c7b', '00f6a57d-9713-4b81-86a2-a58c3624ff23'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:11 devstack sudo[95000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:11 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:11 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.296s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Deleted volume successfully.
Sep 12 20:59:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d49d6708-1325-4fa0-ad55-f02cd334e0d1 tempest-VolumesActionsTest-109355601 None] Lock "cinder-84c28cf1-1c0f-4378-9dcb-f4649779da84-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:12 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (6fbf3a18-af98-4877-ba0a-48c7c73e46ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbff803-5dc7-4295-bb74-e2611e514494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbff803-5dc7-4295-bb74-e2611e514494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217193256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f28c47-9ee9-4696-87db-b75913ab0df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:13Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b545e5a-e217-462a-a111-14243ee008d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b545e5a-e217-462a-a111-14243ee008d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fabbdb-28fe-4f1e-bb95-57314a90b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fabbdb-28fe-4f1e-bb95-57314a90b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f28c47-9ee9-4696-87db-b75913ab0df1', 'volume_name': 'volume-99f28c47-9ee9-4696-87db-b75913ab0df1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b3436e-2d0f-4763-883c-3450e6ac978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b3436e-2d0f-4763-883c-3450e6ac978c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bd6c33-bf36-434a-920d-c7fa22e11eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Volume 99f28c47-9ee9-4696-87db-b75913ab0df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f28c47-9ee9-4696-87db-b75913ab0df1', 'volume_size': 1}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217193256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f28c47-9ee9-4696-87db-b75913ab0df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:13Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Creating volume 99f28c47-9ee9-4696-87db-b75913ab0df1 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:13 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:13 devstack sudo[95004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1 1073741824
Sep 12 20:59:13 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:13 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1 1073741824" returned: 0 in 0.553s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:13 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1
Sep 12 20:59:13 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:14 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1" returned: 0 in 0.314s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bd6c33-bf36-434a-920d-c7fa22e11eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f28c47-9ee9-4696-87db-b75913ab0df1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4f7d96-4834-4e8e-9f5f-9eefbe850baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Volume volume-99f28c47-9ee9-4696-87db-b75913ab0df1 (99f28c47-9ee9-4696-87db-b75913ab0df1): created successfully
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4f7d96-4834-4e8e-9f5f-9eefbe850baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (6fbf3a18-af98-4877-ba0a-48c7c73e46ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-46eebae7-a768-4c6e-8353-996a5dccdcf0 tempest-VolumesActionsTest-1326121589 None] Created volume successfully.
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-99f28c47-9ee9-4696-87db-b75913ab0df1-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Lock "cinder-99f28c47-9ee9-4696-87db-b75913ab0df1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-quobyte-99f28c47-9ee9-4696-87db-b75913ab0df1" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-99f28c47-9ee9-4696-87db-b75913ab0df1" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9be32b-1e25-4a6c-9e1f-71a40cdbe684]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:15 devstack sudo[95014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1
Sep 12 20:59:15 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:15 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1" returned: 0 in 0.394s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:15 devstack sudo[95019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1
Sep 12 20:59:15 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:16 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-99f28c47-9ee9-4696-87db-b75913ab0df1" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-99f28c47-9ee9-4696-87db-b75913ab0df1" released by "delete_volume" :: held 0.716s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Created reservations ['1a0370fe-643b-49cc-af71-a59d43d788cf', '02414254-a810-452c-b9c0-e1495bf26b44', 'd610bcd0-fae8-427b-a1d7-2940ba80e8e2', '0ca68789-1106-4a56-bede-f1b1b60eb70e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:16 devstack sudo[95022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:16 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:16 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.448s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Deleted volume successfully.
Sep 12 20:59:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7adb8091-55f8-48db-b4e2-6ef736e56b79 tempest-VolumesActionsTest-109355601 None] Lock "cinder-99f28c47-9ee9-4696-87db-b75913ab0df1-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (6dc501bf-8525-4339-9586-4d5db00e9f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05592920-474d-4b7b-a741-c04f33d9ff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05592920-474d-4b7b-a741-c04f33d9ff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1859933086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e27e01-48cc-4398-b770-ddc0d00251df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:17Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5c7304-6eb6-460e-b4bf-5a48ce9782ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5c7304-6eb6-460e-b4bf-5a48ce9782ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd91ecc-3b22-4cde-9878-f9141ef94cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd91ecc-3b22-4cde-9878-f9141ef94cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e27e01-48cc-4398-b770-ddc0d00251df', 'volume_name': 'volume-73e27e01-48cc-4398-b770-ddc0d00251df', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1949f4-edf4-486c-ad60-81ac6e0e9e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1949f4-edf4-486c-ad60-81ac6e0e9e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9403dc4-bcdf-40a8-98da-255cf1012996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Volume 73e27e01-48cc-4398-b770-ddc0d00251df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e27e01-48cc-4398-b770-ddc0d00251df', 'volume_size': 1}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1859933086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e27e01-48cc-4398-b770-ddc0d00251df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:17Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Creating volume 73e27e01-48cc-4398-b770-ddc0d00251df {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:17 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:17 devstack sudo[95025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df 1073741824
Sep 12 20:59:17 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:17 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df 1073741824" returned: 0 in 0.623s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:17 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df
Sep 12 20:59:17 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:18 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df" returned: 0 in 0.294s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9403dc4-bcdf-40a8-98da-255cf1012996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e27e01-48cc-4398-b770-ddc0d00251df', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db40a9a-53c1-4115-aebe-b8f4096fd6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:18 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Volume volume-73e27e01-48cc-4398-b770-ddc0d00251df (73e27e01-48cc-4398-b770-ddc0d00251df): created successfully
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db40a9a-53c1-4115-aebe-b8f4096fd6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (6dc501bf-8525-4339-9586-4d5db00e9f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-dce93b1a-269c-4da9-8d0d-420cf524ac9c tempest-VolumesActionsTest-1326121589 None] Created volume successfully.
Sep 12 20:59:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-73e27e01-48cc-4398-b770-ddc0d00251df-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Lock "cinder-73e27e01-48cc-4398-b770-ddc0d00251df-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Acquiring lock "cinder-quobyte-73e27e01-48cc-4398-b770-ddc0d00251df" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-73e27e01-48cc-4398-b770-ddc0d00251df" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b37de-000e-4915-a9fe-aa93c6ba70e9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:19 devstack sudo[95040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df
Sep 12 20:59:19 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:20 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df" returned: 0 in 0.537s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:20 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df
Sep 12 20:59:20 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:20 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-73e27e01-48cc-4398-b770-ddc0d00251df" returned: 0 in 0.293s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Lock "cinder-quobyte-73e27e01-48cc-4398-b770-ddc0d00251df" released by "delete_volume" :: held 0.900s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Created reservations ['15e4ef83-ba2c-477c-a4d8-5d9bee278fb2', 'f609067b-5424-46b5-9afb-822597ff3576', 'e57a3648-260c-454e-adbf-ff33e24fbba8', '239ac9f9-563b-43ac-80b3-4a6dd45f4d47'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:20 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:20 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:21 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.248s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:21 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Deleted volume successfully.
Sep 12 20:59:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-42a2c983-4acc-48de-83b7-7b1bd4a8ecb2 tempest-VolumesActionsTest-109355601 None] Lock "cinder-73e27e01-48cc-4398-b770-ddc0d00251df-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (e439fc9d-8cd8-4184-b57a-de6e7b362edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d72bd90-02e4-4b47-8e94-d169bb127b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d72bd90-02e4-4b47-8e94-d169bb127b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-222371131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120fec44-e884-4d85-a9c9-55100563982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:22Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5291f115-513c-410f-9100-9167eb9393b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5291f115-513c-410f-9100-9167eb9393b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d52dfe7-1030-4b8c-8bf3-400304105951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d52dfe7-1030-4b8c-8bf3-400304105951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120fec44-e884-4d85-a9c9-55100563982a', 'volume_name': 'volume-120fec44-e884-4d85-a9c9-55100563982a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c047f5-3b17-4a75-a0f3-7d81514df19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c047f5-3b17-4a75-a0f3-7d81514df19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f81f39a-124b-422e-9568-1e9cdd112979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Volume 120fec44-e884-4d85-a9c9-55100563982a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120fec44-e884-4d85-a9c9-55100563982a', 'volume_size': 1}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-222371131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120fec44-e884-4d85-a9c9-55100563982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94045388c6c4492bb0f28b96b19539a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:22Z,use_quota=True,user_id='f83a050681874b019692ef12b17fd7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Creating volume 120fec44-e884-4d85-a9c9-55100563982a {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:22 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:22 devstack sudo[95052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a 1073741824
Sep 12 20:59:22 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:23 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a 1073741824" returned: 0 in 0.513s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:23 devstack sudo[95061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a
Sep 12 20:59:23 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:23 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a" returned: 0 in 0.384s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f81f39a-124b-422e-9568-1e9cdd112979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120fec44-e884-4d85-a9c9-55100563982a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4935c0-628e-492b-af42-73d498318767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:23 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Volume volume-120fec44-e884-4d85-a9c9-55100563982a (120fec44-e884-4d85-a9c9-55100563982a): created successfully
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4935c0-628e-492b-af42-73d498318767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Flow 'volume_create_manager' (e439fc9d-8cd8-4184-b57a-de6e7b362edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:23 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cec6848d-84e4-4aa9-b036-112a59b6f422 tempest-VolumesActionsTest-1326121589 None] Created volume successfully.
Sep 12 20:59:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Acquiring lock "cinder-120fec44-e884-4d85-a9c9-55100563982a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Lock "cinder-120fec44-e884-4d85-a9c9-55100563982a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Acquiring lock "cinder-quobyte-120fec44-e884-4d85-a9c9-55100563982a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Lock "cinder-quobyte-120fec44-e884-4d85-a9c9-55100563982a" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:25 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe4ea2b-480f-48dc-909d-2a63ee914a1b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:25 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a
Sep 12 20:59:25 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:26 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a" returned: 0 in 0.487s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:26 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a
Sep 12 20:59:26 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:26 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-120fec44-e884-4d85-a9c9-55100563982a" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Lock "cinder-quobyte-120fec44-e884-4d85-a9c9-55100563982a" released by "delete_volume" :: held 0.830s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Created reservations ['a8ec7790-f1b1-4a3a-9098-4ea3bcd81cd0', '874877d3-3c70-41ca-8795-64e06342ca2c', '63200324-7757-44b4-bf31-eb4ef18da514', '8d758272-cf0a-4b01-9802-3a0c5f27bc36'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:26 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:26 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:27 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.487s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:27 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Deleted volume successfully.
Sep 12 20:59:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-90dd4c7d-a1ee-4933-a659-90eebe2917ca tempest-VolumesActionsTest-1326121589 None] Lock "cinder-120fec44-e884-4d85-a9c9-55100563982a-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Acquiring lock "cinder-085e3be4-07c7-48e8-b7d2-53f890b7b731-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "cinder-085e3be4-07c7-48e8-b7d2-53f890b7b731-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Acquiring lock "cinder-quobyte-085e3be4-07c7-48e8-b7d2-53f890b7b731" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "cinder-quobyte-085e3be4-07c7-48e8-b7d2-53f890b7b731" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de683b1-5bbc-4ff6-acde-6ed8735c07ce]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:30 devstack sudo[95154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731
Sep 12 20:59:30 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:31 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731" returned: 0 in 0.677s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:31 devstack sudo[95173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731
Sep 12 20:59:31 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:31 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-085e3be4-07c7-48e8-b7d2-53f890b7b731" returned: 0 in 0.679s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "cinder-quobyte-085e3be4-07c7-48e8-b7d2-53f890b7b731" released by "delete_volume" :: held 1.440s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:31 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=81,cinder:UPDATE=85,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Created reservations ['f94047e4-8523-48b7-8ae6-3cbceeb31c91', '08638ce1-996c-4047-9099-66bec55818c0', 'bbd56b20-1ff9-4ccf-aebf-d00c485f1f89', '45a40cf0-065b-4250-a2a7-516e9344c7c6'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:32 devstack sudo[95228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:32 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:32 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.574s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Deleted volume successfully.
Sep 12 20:59:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-309c665c-07c9-4b7f-9585-5a29be874ec2 tempest-AttachVolumeShelveTestJSON-1528329681 None] Lock "cinder-085e3be4-07c7-48e8-b7d2-53f890b7b731-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:33 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:33 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:33 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-11a72ed1-db7f-4d29-9911-ccee500ee7f0 req-2891630a-c7d2-4a09-a0c6-d0be5cf0867f tempest-AttachVolumeTestJSON-2142455472 None] Terminate volume connection completed successfully.
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-11a72ed1-db7f-4d29-9911-ccee500ee7f0 req-2891630a-c7d2-4a09-a0c6-d0be5cf0867f tempest-AttachVolumeTestJSON-2142455472 None] Deleting attachment ec072c65-1e75-4061-807d-cf0e5a1a0069. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 20:59:33 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.510s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:43 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=75,cinder:UPDATE=108,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:59:43 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Flow 'volume_create_manager' (58d2fa95-b991-432b-a28a-e9ed786e5c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bd796c-650a-4fb3-99f0-04aeaa0dd6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bd796c-650a-4fb3-99f0-04aeaa0dd6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1367324709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b39f6fa-4b1b-4cad-95b8-964a58336807,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70837f86f78b4d09b75f19dd96a25857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:49Z,use_quota=True,user_id='ec315c67ae534720816efc45204ac693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5cdad2-6444-4f2e-a573-5068f79f8242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5cdad2-6444-4f2e-a573-5068f79f8242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7888e892-cccc-40c2-a6c2-64206d83c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7888e892-cccc-40c2-a6c2-64206d83c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b39f6fa-4b1b-4cad-95b8-964a58336807', 'volume_name': 'volume-0b39f6fa-4b1b-4cad-95b8-964a58336807', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafa0ecb-a1b7-41ea-a45b-786708ce9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafa0ecb-a1b7-41ea-a45b-786708ce9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba70faf1-2144-49c1-9604-a90166ed04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:48 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Volume 0b39f6fa-4b1b-4cad-95b8-964a58336807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b39f6fa-4b1b-4cad-95b8-964a58336807', 'volume_size': 1}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1367324709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b39f6fa-4b1b-4cad-95b8-964a58336807,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='70837f86f78b4d09b75f19dd96a25857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:49Z,use_quota=True,user_id='ec315c67ae534720816efc45204ac693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Creating volume 0b39f6fa-4b1b-4cad-95b8-964a58336807 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:48 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:48 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 1073741824
Sep 12 20:59:48 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:49 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 1073741824" returned: 0 in 0.998s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:49 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807
Sep 12 20:59:49 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:50 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba70faf1-2144-49c1-9604-a90166ed04f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b39f6fa-4b1b-4cad-95b8-964a58336807', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fb8880-f171-4168-8f73-06903245426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:50 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Volume volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 (0b39f6fa-4b1b-4cad-95b8-964a58336807): created successfully
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fb8880-f171-4168-8f73-06903245426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Flow 'volume_create_manager' (58d2fa95-b991-432b-a28a-e9ed786e5c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-371d7baa-ef4e-4898-9e30-40fd6bebfc71 req-56e51a94-00c1-4d72-bc95-b00e187ab9a4 tempest-VolumesGetTestJSON-1871675722 None] Created volume successfully.
Sep 12 20:59:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Acquiring lock "cinder-0b39f6fa-4b1b-4cad-95b8-964a58336807-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Lock "cinder-0b39f6fa-4b1b-4cad-95b8-964a58336807-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Acquiring lock "cinder-quobyte-0b39f6fa-4b1b-4cad-95b8-964a58336807" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 20:59:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Lock "cinder-quobyte-0b39f6fa-4b1b-4cad-95b8-964a58336807" acquired by "delete_volume" :: waited 0.046s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 20:59:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c29b9-f8b3-4be7-9bfd-56f23f4797fa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 20:59:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:52 devstack sudo[95474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807
Sep 12 20:59:52 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:53 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807" returned: 0 in 0.852s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:53 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807
Sep 12 20:59:53 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:53 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0b39f6fa-4b1b-4cad-95b8-964a58336807" returned: 0 in 0.445s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Lock "cinder-quobyte-0b39f6fa-4b1b-4cad-95b8-964a58336807" released by "delete_volume" :: held 1.537s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG cinder.quota [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Created reservations ['b253f3fc-a8bb-44d1-b30d-f01e119b67b7', '084f7a6e-7434-46be-b4ff-494756165975', 'ddb183a2-9fed-4821-aa03-ec51c110ee91', 'e4a02f87-0273-4d9b-b814-ea2c7b88bd9a'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:54 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 20:59:54 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:55 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.674s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:55 devstack cinder-volume[87624]: DEBUG cinder.manager [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 20:59:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Deleted volume successfully.
Sep 12 20:59:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-9588fe7a-29d6-499a-9ddc-385cde37dc43 req-33b04eac-549e-483e-bbd7-b837a575a8f6 tempest-VolumesGetTestJSON-1871675722 None] Lock "cinder-0b39f6fa-4b1b-4cad-95b8-964a58336807-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Flow 'volume_create_manager' (cf13c195-ae84-4d0a-865d-660e556d4796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d30d740-65c3-4794-8053-46668532890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d30d740-65c3-4794-8053-46668532890a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1443309516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3227e26d-b707-4bd4-957c-8e1e061df804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f307c7723ee43c58dd2f7e2bddbb6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:59Z,use_quota=True,user_id='3bf1d46eb22f4fc485de62899959d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e99f78-b3e8-491f-a898-c82e467fae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e99f78-b3e8-491f-a898-c82e467fae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1e4352-7c90-4dff-b8ae-c91f971742a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1e4352-7c90-4dff-b8ae-c91f971742a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3227e26d-b707-4bd4-957c-8e1e061df804', 'volume_name': 'volume-3227e26d-b707-4bd4-957c-8e1e061df804', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730c2c0d-ab94-42ef-b3f4-a8b72657bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730c2c0d-ab94-42ef-b3f4-a8b72657bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6fd2fe-8223-48c1-8f9f-6ec683063bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 20:59:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Volume 3227e26d-b707-4bd4-957c-8e1e061df804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3227e26d-b707-4bd4-957c-8e1e061df804', 'volume_size': 1}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T18:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1443309516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3227e26d-b707-4bd4-957c-8e1e061df804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f307c7723ee43c58dd2f7e2bddbb6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T18:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T18:59:59Z,use_quota=True,user_id='3bf1d46eb22f4fc485de62899959d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Creating volume 3227e26d-b707-4bd4-957c-8e1e061df804 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 20:59:59 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:59 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804 1073741824
Sep 12 20:59:59 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 20:59:59 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804 1073741824" returned: 0 in 0.504s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 20:59:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 20:59:59 devstack sudo[95563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804
Sep 12 20:59:59 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:00 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6fd2fe-8223-48c1-8f9f-6ec683063bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3227e26d-b707-4bd4-957c-8e1e061df804', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787a937c-5398-48a6-bd12-801e65677b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:00 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Volume volume-3227e26d-b707-4bd4-957c-8e1e061df804 (3227e26d-b707-4bd4-957c-8e1e061df804): created successfully
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787a937c-5398-48a6-bd12-801e65677b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Flow 'volume_create_manager' (cf13c195-ae84-4d0a-865d-660e556d4796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-723a174f-ae43-4346-bf8e-a543aa850e92 tempest-ServersNegativeTestJSON-1929551758 None] Created volume successfully.
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Flow 'volume_create_manager' (0eeeb50d-d8d7-4f77-9913-9226025b20f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541aed0f-4d57-42e1-9ecd-ec2296930ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541aed0f-4d57-42e1-9ecd-ec2296930ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1183971211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d8ca55-f333-4329-b968-e9eb0e92a3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f307c7723ee43c58dd2f7e2bddbb6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:03Z,use_quota=True,user_id='3bf1d46eb22f4fc485de62899959d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36c6832-2e02-446a-955a-655d5abb5c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36c6832-2e02-446a-955a-655d5abb5c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65cf41c-4cca-4c51-b131-cd62f6aca3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65cf41c-4cca-4c51-b131-cd62f6aca3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d8ca55-f333-4329-b968-e9eb0e92a3c5', 'volume_name': 'volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c18a15-1ac1-4cd9-a3af-9c3ddb954cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c18a15-1ac1-4cd9-a3af-9c3ddb954cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a01731-f6a2-4728-a3a0-2500770e60a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:02 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Volume 13d8ca55-f333-4329-b968-e9eb0e92a3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5', 'volume_size': 1}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1183971211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d8ca55-f333-4329-b968-e9eb0e92a3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f307c7723ee43c58dd2f7e2bddbb6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:03Z,use_quota=True,user_id='3bf1d46eb22f4fc485de62899959d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Creating volume 13d8ca55-f333-4329-b968-e9eb0e92a3c5 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:02 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:02 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 1073741824
Sep 12 21:00:02 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:03 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 1073741824" returned: 0 in 0.469s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:03 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5
Sep 12 21:00:03 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Flow 'volume_create_manager' (5f354e09-cb36-4459-80db-ad3c322f6810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f358a5d-7aea-4871-b42e-28211030e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f358a5d-7aea-4871-b42e-28211030e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1602697916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f569dd8-ba75-4287-9c7a-751bb378094a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c70410c33674775b97b2e01bc50a453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:03Z,use_quota=True,user_id='20bdab01f2034eacab3b24914ca71a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659a476c-a08f-4e15-926e-654d6fde85d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659a476c-a08f-4e15-926e-654d6fde85d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ffef99-6801-4cd9-b902-95c5b2a70539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ffef99-6801-4cd9-b902-95c5b2a70539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f569dd8-ba75-4287-9c7a-751bb378094a', 'volume_name': 'volume-5f569dd8-ba75-4287-9c7a-751bb378094a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec01329-e0f3-4682-a866-56dff9202139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec01329-e0f3-4682-a866-56dff9202139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b227c9-fa8d-4819-8120-faaac0b6c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Volume 5f569dd8-ba75-4287-9c7a-751bb378094a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f569dd8-ba75-4287-9c7a-751bb378094a', 'volume_size': 1}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:03 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5" returned: 0 in 0.259s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1602697916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f569dd8-ba75-4287-9c7a-751bb378094a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c70410c33674775b97b2e01bc50a453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:03Z,use_quota=True,user_id='20bdab01f2034eacab3b24914ca71a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Creating volume 5f569dd8-ba75-4287-9c7a-751bb378094a {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:03 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:03 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a 1073741824
Sep 12 21:00:03 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a01731-f6a2-4728-a3a0-2500770e60a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9375ae-2588-4dcb-af00-c503a49f8bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Volume volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 (13d8ca55-f333-4329-b968-e9eb0e92a3c5): created successfully
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9375ae-2588-4dcb-af00-c503a49f8bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Flow 'volume_create_manager' (0eeeb50d-d8d7-4f77-9913-9226025b20f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-259946b9-62c5-430c-a520-4a613747f4c6 tempest-ServersNegativeTestJSON-1929551758 None] Created volume successfully.
Sep 12 21:00:03 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a 1073741824" returned: 0 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:04 devstack sudo[95585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a
Sep 12 21:00:04 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:04 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b227c9-fa8d-4819-8120-faaac0b6c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f569dd8-ba75-4287-9c7a-751bb378094a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6df0f1-a873-4fba-b7d6-943f46d32830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Volume volume-5f569dd8-ba75-4287-9c7a-751bb378094a (5f569dd8-ba75-4287-9c7a-751bb378094a): created successfully
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6df0f1-a873-4fba-b7d6-943f46d32830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Flow 'volume_create_manager' (5f354e09-cb36-4459-80db-ad3c322f6810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bfe678bc-61bd-43ad-ba2c-3f9c1e36f2c0 tempest-VolumesTransfersTest-480322749 None] Created volume successfully.
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "cinder-13d8ca55-f333-4329-b968-e9eb0e92a3c5-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-13d8ca55-f333-4329-b968-e9eb0e92a3c5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "cinder-quobyte-13d8ca55-f333-4329-b968-e9eb0e92a3c5" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-quobyte-13d8ca55-f333-4329-b968-e9eb0e92a3c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e5bd28-bf02-426a-916f-bdc31dc5e7bf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:05 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5
Sep 12 21:00:05 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:05 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5" returned: 0 in 0.396s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:05 devstack sudo[95593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5
Sep 12 21:00:05 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:05 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13d8ca55-f333-4329-b968-e9eb0e92a3c5" returned: 0 in 0.295s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-quobyte-13d8ca55-f333-4329-b968-e9eb0e92a3c5" released by "delete_volume" :: held 0.736s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:05 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Created reservations ['fa14cc75-2266-400f-8ffe-c6c196784417', 'b358c09f-e2bc-457c-a803-00aa145b9f38', 'dd974d35-db89-4571-913f-1e08b31fe004', '9f9f9ef1-1c36-424b-ae82-36ca04967dc9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:06 devstack sudo[95596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:06 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2a4515ec-dd32-4cd7-9335-b7a6e69c5454 tempest-VolumesTransfersTest-603377666 None] Transfer volume completed successfully.
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "cinder-3227e26d-b707-4bd4-957c-8e1e061df804-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-3227e26d-b707-4bd4-957c-8e1e061df804-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "cinder-quobyte-3227e26d-b707-4bd4-957c-8e1e061df804" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:06 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-quobyte-3227e26d-b707-4bd4-957c-8e1e061df804" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Deleted volume successfully.
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[018565bd-92eb-4ce9-8d04-e96fb4e22eb6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8cb8fb32-4d49-4bc1-8679-3d46ae789b65 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-13d8ca55-f333-4329-b968-e9eb0e92a3c5-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:06 devstack sudo[95599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804
Sep 12 21:00:06 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:06 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804" returned: 0 in 0.466s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:06 devstack sudo[95604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804
Sep 12 21:00:06 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Acquiring lock "cinder-5f569dd8-ba75-4287-9c7a-751bb378094a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-5f569dd8-ba75-4287-9c7a-751bb378094a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Acquiring lock "cinder-quobyte-5f569dd8-ba75-4287-9c7a-751bb378094a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-quobyte-5f569dd8-ba75-4287-9c7a-751bb378094a" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b627e214-021b-45aa-a274-9be3481346a3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:07 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3227e26d-b707-4bd4-957c-8e1e061df804" returned: 0 in 0.327s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:07 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a
Sep 12 21:00:07 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-quobyte-3227e26d-b707-4bd4-957c-8e1e061df804" released by "delete_volume" :: held 0.860s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Created reservations ['16dcd2ac-c99b-4036-9319-02cc5c55bdd0', '3048a47b-2f7f-46a3-a94d-07467e68e3d7', '3ed5959b-f4ff-41be-8422-406c3df57311', '4f46ff4d-c0e9-4d66-8d9d-87a3d66a9a80'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:07 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:07 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:07 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a" returned: 0 in 0.507s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:07 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a
Sep 12 21:00:07 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:08 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.615s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Deleted volume successfully.
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31f0457a-6de8-4f36-88e6-165ef876fe00 tempest-ServersNegativeTestJSON-1929551758 None] Lock "cinder-3227e26d-b707-4bd4-957c-8e1e061df804-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:08 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f569dd8-ba75-4287-9c7a-751bb378094a" returned: 0 in 0.647s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-quobyte-5f569dd8-ba75-4287-9c7a-751bb378094a" released by "delete_volume" :: held 1.215s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Created reservations ['d0b4b497-abb6-41a9-bb44-9fc31b30b0bd', '82e70d00-876d-4bac-919a-503a1c2ce1e2', '41f1c043-4d1f-4869-8105-ac5b59d5b4cc', 'a9ad483c-25c8-4201-a2f2-8a320094fc43'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:08 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:08 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:08 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:08 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Deleted volume successfully.
Sep 12 21:00:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-59ffcbfa-d7fc-4c63-9d9b-39c5a8513e43 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-5f569dd8-ba75-4287-9c7a-751bb378094a-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Flow 'volume_create_manager' (95f48fce-1a5b-4acc-b090-2f2de09e52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac6226d-df9b-4295-8f27-3e3d75de5a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac6226d-df9b-4295-8f27-3e3d75de5a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-152038567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31904d48-502d-4a2a-8386-77a94538fa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c70410c33674775b97b2e01bc50a453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:10Z,use_quota=True,user_id='20bdab01f2034eacab3b24914ca71a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6ab369-32c7-4b5b-ac78-fc61f21c95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6ab369-32c7-4b5b-ac78-fc61f21c95c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cefd0fe-28da-4b07-aa10-e28123001409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cefd0fe-28da-4b07-aa10-e28123001409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31904d48-502d-4a2a-8386-77a94538fa5d', 'volume_name': 'volume-31904d48-502d-4a2a-8386-77a94538fa5d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798c0754-29cf-42d3-89f9-8c98fc4928f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798c0754-29cf-42d3-89f9-8c98fc4928f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6d4031-6de4-4335-b6ba-72218d7cfa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Volume 31904d48-502d-4a2a-8386-77a94538fa5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31904d48-502d-4a2a-8386-77a94538fa5d', 'volume_size': 1}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-152038567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31904d48-502d-4a2a-8386-77a94538fa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c70410c33674775b97b2e01bc50a453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:10Z,use_quota=True,user_id='20bdab01f2034eacab3b24914ca71a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Creating volume 31904d48-502d-4a2a-8386-77a94538fa5d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:10 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:10 devstack sudo[95648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d 1073741824
Sep 12 21:00:10 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:10 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d 1073741824" returned: 0 in 0.607s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:11 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d
Sep 12 21:00:11 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:11 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6d4031-6de4-4335-b6ba-72218d7cfa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31904d48-502d-4a2a-8386-77a94538fa5d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06258019-69a2-407c-911e-c7a7845a3515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:11 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Volume volume-31904d48-502d-4a2a-8386-77a94538fa5d (31904d48-502d-4a2a-8386-77a94538fa5d): created successfully
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06258019-69a2-407c-911e-c7a7845a3515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Flow 'volume_create_manager' (95f48fce-1a5b-4acc-b090-2f2de09e52a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3533b7e9-22cd-4aab-8432-ffc847fe52e6 tempest-VolumesTransfersTest-480322749 None] Created volume successfully.
Sep 12 21:00:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Acquiring lock "cinder-31904d48-502d-4a2a-8386-77a94538fa5d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-31904d48-502d-4a2a-8386-77a94538fa5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Acquiring lock "cinder-quobyte-31904d48-502d-4a2a-8386-77a94538fa5d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-quobyte-31904d48-502d-4a2a-8386-77a94538fa5d" acquired by "delete_volume" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:12 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7be93-ec87-4eee-b997-03f50f257a72]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:12 devstack sudo[95681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d
Sep 12 21:00:12 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:13 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d" returned: 0 in 0.452s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:13 devstack sudo[95686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d
Sep 12 21:00:13 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:13 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-31904d48-502d-4a2a-8386-77a94538fa5d" returned: 0 in 0.261s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-quobyte-31904d48-502d-4a2a-8386-77a94538fa5d" released by "delete_volume" :: held 0.769s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Created reservations ['66c573f0-04b2-407e-84c8-63ee49410309', '8654efd8-8b90-4848-b2d0-2e08c81dd58a', '035be73b-e84a-4875-af29-da80f533bc1f', '31e4f81b-e46f-4d71-b734-a2a12c931b31'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:13 devstack sudo[95690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:13 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:14 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.409s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:14 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Deleted volume successfully.
Sep 12 21:00:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3a080f30-73a4-4039-9bcb-5667c5b341f7 tempest-VolumesTransfersTest-1194970474 None] Lock "cinder-31904d48-502d-4a2a-8386-77a94538fa5d-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Flow 'volume_create_manager' (78fe397c-a453-4918-b4ea-31745514c312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5f88dc-f2ba-4e59-99f8-412d69f00097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5f88dc-f2ba-4e59-99f8-412d69f00097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-304159176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d46926-1222-467f-b582-56382a54d0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b745a1a72e4c67b23be749b54f1b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:16Z,use_quota=True,user_id='04a0eb915cca43159f838c9f97a611b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddb93c2-f0bc-4c2b-9cfe-8d535d1b9c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddb93c2-f0bc-4c2b-9cfe-8d535d1b9c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c7bd37-b1c8-4fe1-8de2-10f4e09cdc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c7bd37-b1c8-4fe1-8de2-10f4e09cdc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d46926-1222-467f-b582-56382a54d0a4', 'volume_name': 'volume-43d46926-1222-467f-b582-56382a54d0a4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2a5b01-2f6e-4415-bf39-79338a68a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2a5b01-2f6e-4415-bf39-79338a68a495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb1d528-4adc-4166-a371-b03a5487750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Volume 43d46926-1222-467f-b582-56382a54d0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d46926-1222-467f-b582-56382a54d0a4', 'volume_size': 1}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-304159176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d46926-1222-467f-b582-56382a54d0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b745a1a72e4c67b23be749b54f1b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:16Z,use_quota=True,user_id='04a0eb915cca43159f838c9f97a611b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Creating volume 43d46926-1222-467f-b582-56382a54d0a4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:15 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:15 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4 1073741824
Sep 12 21:00:15 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:16 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4 1073741824" returned: 0 in 0.557s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:16 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4
Sep 12 21:00:16 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:16 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4" returned: 0 in 0.275s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb1d528-4adc-4166-a371-b03a5487750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d46926-1222-467f-b582-56382a54d0a4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fdea65-2f55-45bb-b168-deb74e43fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Volume volume-43d46926-1222-467f-b582-56382a54d0a4 (43d46926-1222-467f-b582-56382a54d0a4): created successfully
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fdea65-2f55-45bb-b168-deb74e43fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Flow 'volume_create_manager' (78fe397c-a453-4918-b4ea-31745514c312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-05a7ad82-4605-4ff9-b55c-d4d007b3d538 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Created volume successfully.
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "cinder-43d46926-1222-467f-b582-56382a54d0a4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "cinder-43d46926-1222-467f-b582-56382a54d0a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "cinder-quobyte-43d46926-1222-467f-b582-56382a54d0a4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "cinder-quobyte-43d46926-1222-467f-b582-56382a54d0a4" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[233341f5-ee69-48bc-b58e-3d8e3a7d7b92]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:18 devstack sudo[95709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4
Sep 12 21:00:18 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:18 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4" returned: 0 in 0.435s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:18 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4
Sep 12 21:00:18 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:18 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-43d46926-1222-467f-b582-56382a54d0a4" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "cinder-quobyte-43d46926-1222-467f-b582-56382a54d0a4" released by "delete_volume" :: held 0.848s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Created reservations ['e7ff04a0-f0fa-4911-8f6c-0ea0ede4824b', 'def7546e-71a2-4696-9abe-5b74d8cb245b', 'c4b27ee6-4821-4d4c-b6f8-434ffbc248eb', 'b8c5cb99-ec2b-477d-b038-f3ea8a54aa0a'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:19 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:19 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:19 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.390s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Deleted volume successfully.
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-912fd838-ed8a-453b-9bc7-c700af588113 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "cinder-43d46926-1222-467f-b582-56382a54d0a4-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:19 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Flow 'volume_create_manager' (abe0d46e-973b-427a-8dbb-4c5c715218cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8997c14-f27d-414c-8735-10fb8a7a768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8997c14-f27d-414c-8735-10fb8a7a768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1897942715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f9a9a9-df72-4afd-887b-042dd15149c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b745a1a72e4c67b23be749b54f1b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:20Z,use_quota=True,user_id='04a0eb915cca43159f838c9f97a611b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dda8a46-6d19-4fbf-83ac-bf118610de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dda8a46-6d19-4fbf-83ac-bf118610de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66be90b0-8951-4f05-8e66-a423acb86134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66be90b0-8951-4f05-8e66-a423acb86134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f9a9a9-df72-4afd-887b-042dd15149c8', 'volume_name': 'volume-81f9a9a9-df72-4afd-887b-042dd15149c8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a797bbe-f890-42d6-b0f7-ca9dbf96573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a797bbe-f890-42d6-b0f7-ca9dbf96573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766c1785-0dc2-4442-9278-eb68e107b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:20 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Volume 81f9a9a9-df72-4afd-887b-042dd15149c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f9a9a9-df72-4afd-887b-042dd15149c8', 'volume_size': 1}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1897942715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f9a9a9-df72-4afd-887b-042dd15149c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b745a1a72e4c67b23be749b54f1b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:20Z,use_quota=True,user_id='04a0eb915cca43159f838c9f97a611b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Creating volume 81f9a9a9-df72-4afd-887b-042dd15149c8 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:20 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:20 devstack sudo[95728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8 1073741824
Sep 12 21:00:20 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:20 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8 1073741824" returned: 0 in 0.631s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:20 devstack sudo[95733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8
Sep 12 21:00:20 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:21 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766c1785-0dc2-4442-9278-eb68e107b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f9a9a9-df72-4afd-887b-042dd15149c8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8050aa9-1fb6-4a34-85f7-249f4cd92521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:21 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Volume volume-81f9a9a9-df72-4afd-887b-042dd15149c8 (81f9a9a9-df72-4afd-887b-042dd15149c8): created successfully
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8050aa9-1fb6-4a34-85f7-249f4cd92521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Flow 'volume_create_manager' (abe0d46e-973b-427a-8dbb-4c5c715218cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-76264ed9-c7d1-4d4d-9c28-762c7ac8bed4 tempest-VolumeQuotasAdminTestJSON-2019754748 None] Created volume successfully.
Sep 12 21:00:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8ed41f1a-b112-4f09-a479-6c1330341d3a tempest-VolumeQuotasAdminTestJSON-119522346 None] Transfer volume completed successfully.
Sep 12 21:00:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Acquiring lock "cinder-81f9a9a9-df72-4afd-887b-042dd15149c8-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Lock "cinder-81f9a9a9-df72-4afd-887b-042dd15149c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Acquiring lock "cinder-quobyte-81f9a9a9-df72-4afd-887b-042dd15149c8" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Lock "cinder-quobyte-81f9a9a9-df72-4afd-887b-042dd15149c8" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839c292-d80d-456a-af1a-02e4aee8f98d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:23 devstack sudo[95754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8
Sep 12 21:00:23 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:24 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8" returned: 0 in 0.539s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:24 devstack sudo[95775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8
Sep 12 21:00:24 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:25 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-81f9a9a9-df72-4afd-887b-042dd15149c8" returned: 0 in 0.709s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Lock "cinder-quobyte-81f9a9a9-df72-4afd-887b-042dd15149c8" released by "delete_volume" :: held 1.341s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Created reservations ['5f546cd6-8ee6-4679-ac01-a9477d327608', '912fb17c-f31f-43a9-abfd-db9edcde641d', '2c0910dd-a3db-4f66-b3d4-e3485ffa8004', '38b2a1d0-d246-4601-b656-6105a2d797ba'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:25 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:25 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Flow 'volume_create_manager' (20cee689-bb7f-4031-99cf-ad233b89ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e59a33-b3a8-4f42-8de6-3de20a2270bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:25 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e59a33-b3a8-4f42-8de6-3de20a2270bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1023842539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60c8504afd4a1aa2604b11f57d5419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:26Z,use_quota=True,user_id='73b99e8a5193468cb960dea09dbf1a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9327eb50-825d-4a5f-99d7-3cbe3cb1156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9327eb50-825d-4a5f-99d7-3cbe3cb1156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1006b254-b8dd-474d-b3fe-d3e19add4b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1006b254-b8dd-474d-b3fe-d3e19add4b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d', 'volume_name': 'volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0f87c-8c00-4e70-bf16-af052955263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0f87c-8c00-4e70-bf16-af052955263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28de907a-ac70-458a-89db-7d32ac8d29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:25 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Volume 1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d', 'volume_size': 1}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1023842539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60c8504afd4a1aa2604b11f57d5419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:26Z,use_quota=True,user_id='73b99e8a5193468cb960dea09dbf1a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Creating volume 1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:25 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Deleted volume successfully.
Sep 12 21:00:25 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d 1073741824
Sep 12 21:00:25 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9c24f26c-2fe7-412d-8304-b3187f325e40 tempest-VolumeQuotasAdminTestJSON-1889503063 None] Lock "cinder-81f9a9a9-df72-4afd-887b-042dd15149c8-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:26 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d 1073741824" returned: 0 in 0.874s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:26 devstack sudo[95841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d
Sep 12 21:00:26 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:27 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d" returned: 0 in 0.350s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28de907a-ac70-458a-89db-7d32ac8d29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2022054-7427-416c-875b-fcea21d9b558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:27 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Volume volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d (1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d): created successfully
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2022054-7427-416c-875b-fcea21d9b558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Flow 'volume_create_manager' (20cee689-bb7f-4031-99cf-ad233b89ff85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-85580209-a615-42b4-873b-e4630553207c tempest-VolumesTransfersV355Test-1351534084 None] Created volume successfully.
Sep 12 21:00:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-eeeaf326-451b-4dc9-be9b-5b10ed03c9a7 tempest-VolumesTransfersV355Test-695095915 None] Transfer volume completed successfully.
Sep 12 21:00:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Acquiring lock "cinder-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Acquiring lock "cinder-quobyte-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-quobyte-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1293764e-0c14-460f-90a0-8d857708207a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:30 devstack sudo[95845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d
Sep 12 21:00:30 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:31 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d" returned: 0 in 0.527s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:31 devstack sudo[95851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d
Sep 12 21:00:31 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:31 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d" returned: 0 in 0.408s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-quobyte-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d" released by "delete_volume" :: held 1.006s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Created reservations ['2f3a6671-87d4-4abb-b964-18de4f03ca46', '48289629-3be1-4209-9b1c-c364d298ca95', '62a98c38-92db-4aae-a478-68d7da38d3c0', '32a5f461-a25f-412e-b003-9c4c39602c32'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:31 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:31 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:32 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.446s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:32 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Deleted volume successfully.
Sep 12 21:00:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-be239a8f-7a58-46cd-b516-6c51e3265207 tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-1368b9c0-5e5c-4078-a53d-e1ce28ec1d4d-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:33 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:33 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Flow 'volume_create_manager' (4e31793b-5da2-4772-a66b-4272edf1069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ddd7da-cb56-4b50-816b-d1d65bb0af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ddd7da-cb56-4b50-816b-d1d65bb0af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1554363186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877cbef5-b8df-4d73-8b4c-ce72d6ba90f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60c8504afd4a1aa2604b11f57d5419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:34Z,use_quota=True,user_id='73b99e8a5193468cb960dea09dbf1a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678ec88e-a521-45ba-ad92-c103853cb962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678ec88e-a521-45ba-ad92-c103853cb962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084937c7-5fac-4c8b-b1de-9fe502577d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084937c7-5fac-4c8b-b1de-9fe502577d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877cbef5-b8df-4d73-8b4c-ce72d6ba90f3', 'volume_name': 'volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3073de4d-0c77-4b4f-83ff-3fd15e343c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3073de4d-0c77-4b4f-83ff-3fd15e343c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1489b181-8571-4169-9544-5f4e0e28d298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:33 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Volume 877cbef5-b8df-4d73-8b4c-ce72d6ba90f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3', 'volume_size': 1}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1554363186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877cbef5-b8df-4d73-8b4c-ce72d6ba90f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60c8504afd4a1aa2604b11f57d5419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:34Z,use_quota=True,user_id='73b99e8a5193468cb960dea09dbf1a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Creating volume 877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:33 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:33 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 1073741824
Sep 12 21:00:33 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:34 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.722s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:34 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:34 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 1073741824" returned: 0 in 0.634s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:34 devstack sudo[95868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3
Sep 12 21:00:34 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:34 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3" returned: 0 in 0.510s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1489b181-8571-4169-9544-5f4e0e28d298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6181e6-5161-402b-8306-0f4c5523210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:35 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Volume volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 (877cbef5-b8df-4d73-8b4c-ce72d6ba90f3): created successfully
Sep 12 21:00:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6181e6-5161-402b-8306-0f4c5523210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Flow 'volume_create_manager' (4e31793b-5da2-4772-a66b-4272edf1069d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-095d8bcd-028e-40d0-86b3-42778d321da2 tempest-VolumesTransfersV355Test-1351534084 None] Created volume successfully.
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Acquiring lock "cinder-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Acquiring lock "cinder-quobyte-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-quobyte-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fec68e1-61d9-4b2e-9c89-3eee1d2e9b98]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:36 devstack sudo[95871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3
Sep 12 21:00:36 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:36 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3" returned: 0 in 0.441s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:36 devstack sudo[95876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3
Sep 12 21:00:36 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:37 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-quobyte-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3" released by "delete_volume" :: held 0.853s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Created reservations ['2470edb0-b338-45cb-befb-46d0ccff2002', '1d89367f-4934-46e8-ab99-2bbead877116', '0ee3567b-bbb1-49ab-805b-6aa89d4e224d', 'd6cd7e84-79d9-43d1-b759-02b625f72980'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:37 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:37 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:37 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.461s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Deleted volume successfully.
Sep 12 21:00:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-385fdb5e-96a9-4497-8841-e2e1b7acc04d tempest-VolumesTransfersV355Test-397920590 None] Lock "cinder-877cbef5-b8df-4d73-8b4c-ce72d6ba90f3-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Flow 'volume_create_manager' (788f4821-8dfb-42f6-b4ac-f1a08dca9d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db4ef7a-c9d3-48b9-8ce7-fe274a8a4c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db4ef7a-c9d3-48b9-8ce7-fe274a8a4c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1412898590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10173d9-4a1e-48ee-a4c6-f44a4076d390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485b95bc930a4da493675bfefd1e0ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:41Z,use_quota=True,user_id='ff8b1821604946659ede2b0115ece964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc1765d-d22f-4f4e-9431-67fe7fa5b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc1765d-d22f-4f4e-9431-67fe7fa5b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662983ba-a540-4ae3-8429-9e99d26e17ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662983ba-a540-4ae3-8429-9e99d26e17ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10173d9-4a1e-48ee-a4c6-f44a4076d390', 'volume_name': 'volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b1f2a4-845b-4dd0-925a-e786e1c6ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b1f2a4-845b-4dd0-925a-e786e1c6ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805a76fb-cc46-4034-a448-6fdb9a788f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Volume c10173d9-4a1e-48ee-a4c6-f44a4076d390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390', 'volume_size': 1}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1412898590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10173d9-4a1e-48ee-a4c6-f44a4076d390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485b95bc930a4da493675bfefd1e0ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:41Z,use_quota=True,user_id='ff8b1821604946659ede2b0115ece964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Creating volume c10173d9-4a1e-48ee-a4c6-f44a4076d390 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:40 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:40 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 1073741824
Sep 12 21:00:40 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:41 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 1073741824" returned: 0 in 0.551s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:41 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390
Sep 12 21:00:41 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:41 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390" returned: 0 in 0.301s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805a76fb-cc46-4034-a448-6fdb9a788f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2a999d-aa82-40d0-99a6-74035a88f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Volume volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 (c10173d9-4a1e-48ee-a4c6-f44a4076d390): created successfully
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2a999d-aa82-40d0-99a6-74035a88f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Flow 'volume_create_manager' (788f4821-8dfb-42f6-b4ac-f1a08dca9d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-727176f9-4255-42ba-84f5-0656236bbdb4 tempest-VolumeQuotasNegativeTestJSON-220347030 None] Created volume successfully.
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Acquiring lock "cinder-c10173d9-4a1e-48ee-a4c6-f44a4076d390-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "cinder-c10173d9-4a1e-48ee-a4c6-f44a4076d390-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=73,cinder:UPDATE=98,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=62,cinder:UPDATE=108,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Acquiring lock "cinder-quobyte-c10173d9-4a1e-48ee-a4c6-f44a4076d390" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "cinder-quobyte-c10173d9-4a1e-48ee-a4c6-f44a4076d390" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[653cd02d-fe54-4cdd-a30d-e94b0c2e4888]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:44 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390
Sep 12 21:00:44 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:44 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390" returned: 0 in 0.560s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:44 devstack sudo[95946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390
Sep 12 21:00:44 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:45 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c10173d9-4a1e-48ee-a4c6-f44a4076d390" returned: 0 in 0.339s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "cinder-quobyte-c10173d9-4a1e-48ee-a4c6-f44a4076d390" released by "delete_volume" :: held 0.970s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Created reservations ['ff1b6b01-3568-43a0-b052-296310532c00', '05c955ee-0be3-4249-86f9-06af69516d82', '81fd11e9-3778-4666-b9dd-e6432eff83a9', '5f18b3c2-caa8-4ac4-b66c-4e58b2a4f54f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:45 devstack sudo[95949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:45 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:46 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Flow 'volume_create_manager' (b6d17634-0eec-43b2-824e-4cc1e51e0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01441b23-f3f3-425f-805b-b948d2c54e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.735s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Deleted volume successfully.
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01441b23-f3f3-425f-805b-b948d2c54e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-836732012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fdef6f-116a-40ff-a0dd-16248dd4659d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab010cbf8df4032864940ca7e6ce33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:46Z,use_quota=True,user_id='e56d919ed16942c3bcaf1dbb2cbbe0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8234f09-0e80-4ac6-91d8-d3393a92afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8234f09-0e80-4ac6-91d8-d3393a92afc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16a64a0-4d4e-4bf0-9cb6-726e0e804b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16a64a0-4d4e-4bf0-9cb6-726e0e804b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fdef6f-116a-40ff-a0dd-16248dd4659d', 'volume_name': 'volume-79fdef6f-116a-40ff-a0dd-16248dd4659d', 'volume_size': 2}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29150f4-3179-4f8d-b136-e9f30fdc7e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29150f4-3179-4f8d-b136-e9f30fdc7e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d581ce79-8d10-4432-93a8-2613afdea61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:46 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Volume 79fdef6f-116a-40ff-a0dd-16248dd4659d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fdef6f-116a-40ff-a0dd-16248dd4659d', 'volume_size': 2}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-836732012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fdef6f-116a-40ff-a0dd-16248dd4659d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab010cbf8df4032864940ca7e6ce33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:46Z,use_quota=True,user_id='e56d919ed16942c3bcaf1dbb2cbbe0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Creating volume 79fdef6f-116a-40ff-a0dd-16248dd4659d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:46 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d 2147483648 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b5dc9e6-b5f5-4d8a-8151-72afd294789d tempest-VolumeQuotasNegativeTestJSON-220347030 None] Lock "cinder-c10173d9-4a1e-48ee-a4c6-f44a4076d390-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:46 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d 2147483648
Sep 12 21:00:46 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:47 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d 2147483648" returned: 0 in 0.969s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:47 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d
Sep 12 21:00:47 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:47 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d581ce79-8d10-4432-93a8-2613afdea61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fdef6f-116a-40ff-a0dd-16248dd4659d', 'volume_size': 2}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d1ae0b-c2e8-407b-a846-be829f84b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:47 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Volume volume-79fdef6f-116a-40ff-a0dd-16248dd4659d (79fdef6f-116a-40ff-a0dd-16248dd4659d): created successfully
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d1ae0b-c2e8-407b-a846-be829f84b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Flow 'volume_create_manager' (b6d17634-0eec-43b2-824e-4cc1e51e0813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ba41ed51-1406-493a-9a84-9714e623b8a5 tempest-VolumesCloneNegativeTest-1210379894 None] Created volume successfully.
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Acquiring lock "cinder-79fdef6f-116a-40ff-a0dd-16248dd4659d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Lock "cinder-79fdef6f-116a-40ff-a0dd-16248dd4659d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Acquiring lock "cinder-quobyte-79fdef6f-116a-40ff-a0dd-16248dd4659d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Lock "cinder-quobyte-79fdef6f-116a-40ff-a0dd-16248dd4659d" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4f28f-50df-4e8b-9fbf-50f39a1478d9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:49 devstack sudo[96032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d
Sep 12 21:00:49 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:49 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d" returned: 0 in 0.609s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:50 devstack sudo[96039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d
Sep 12 21:00:50 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:50 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79fdef6f-116a-40ff-a0dd-16248dd4659d" returned: 0 in 0.400s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Lock "cinder-quobyte-79fdef6f-116a-40ff-a0dd-16248dd4659d" released by "delete_volume" :: held 1.087s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Created reservations ['82fc58c4-81a5-4bc4-bf8d-f45af76f365f', '0dbf9bc9-290b-4d4a-9bf2-df2bf70ec22f', '38a3de0a-d543-4a72-b8f4-24edb1b52d18', '950c4532-a1c5-47ce-917c-92fe50ad8db8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:50 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:50 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:51 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.414s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:00:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Deleted volume successfully.
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Flow 'volume_create_manager' (872fedf1-06ee-4cf4-b4df-f890c1758c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f914349c-6108-4767-9c89-dae1a19da5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f914349c-6108-4767-9c89-dae1a19da5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1347589135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe6a34d-9066-4ead-b7d1-05dae95e9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dd24c17807440584f86db404d79feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:51Z,use_quota=True,user_id='e8bbab724b854781a4fadddf2b022b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e093562-da48-4051-921d-63e971565a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e093562-da48-4051-921d-63e971565a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a3bb1c-f8ff-411b-bdab-0e409021e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a3bb1c-f8ff-411b-bdab-0e409021e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe6a34d-9066-4ead-b7d1-05dae95e9b58', 'volume_name': 'volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae59c63c-64d8-410f-a3f4-850cbe49c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae59c63c-64d8-410f-a3f4-850cbe49c80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117d5ff4-5972-44c6-9e18-5023c7b2a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Volume ffe6a34d-9066-4ead-b7d1-05dae95e9b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58', 'volume_size': 1}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1347589135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe6a34d-9066-4ead-b7d1-05dae95e9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dd24c17807440584f86db404d79feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:51Z,use_quota=True,user_id='e8bbab724b854781a4fadddf2b022b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Creating volume ffe6a34d-9066-4ead-b7d1-05dae95e9b58 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:51 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-372c9c6c-29dd-4aa9-904e-ff0cc2e45bdf tempest-VolumesCloneNegativeTest-1210379894 None] Lock "cinder-79fdef6f-116a-40ff-a0dd-16248dd4659d-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:00:51 devstack sudo[96046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 1073741824
Sep 12 21:00:51 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:52 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 1073741824" returned: 0 in 0.823s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:52 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58
Sep 12 21:00:52 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:52 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" returned: 0 in 0.359s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117d5ff4-5972-44c6-9e18-5023c7b2a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ca9b72-099e-4b00-a2e0-992c1414a9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Volume volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 (ffe6a34d-9066-4ead-b7d1-05dae95e9b58): created successfully
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ca9b72-099e-4b00-a2e0-992c1414a9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Flow 'volume_create_manager' (872fedf1-06ee-4cf4-b4df-f890c1758c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a0120f39-ae5e-4328-87fb-5227ca2b6b2a tempest-AttachVolumeTestJSON-2142455472 None] Created volume successfully.
Sep 12 21:00:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780aedf-f3ee-4061-9119-eabc4b6ea41a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:00:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:54 devstack sudo[96087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58
Sep 12 21:00:54 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:55 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" returned: 0 in 0.503s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.538s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91cefa94-b451-48ef-aaaf-cc11940aa57f', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:00:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-34b6ac06-d874-41fe-8e2d-736f182a1215 req-eab9bbd1-a85b-4e0c-9030-af8a4e0bcda0 tempest-AttachVolumeTestJSON-2142455472 None] attachment_update completed successfully.
Sep 12 21:00:56 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Flow 'volume_create_manager' (e7d8d3a4-0e24-4924-a541-9222520b48a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac0305b-680e-4232-8d02-04222b6af03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac0305b-680e-4232-8d02-04222b6af03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1902810172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513f93fc-9573-4d59-a965-3b6a53dc00c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f829c277283f4df2b2a92a261c7953d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:57Z,use_quota=True,user_id='b9ee5f1ec13f45969d8da9d057b80a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d7903d1-0347-49d4-b57b-1d125704f66d),volume_type_id=4d7903d1-0347-49d4-b57b-1d125704f66d)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2dceaec-32ca-4da8-b2ba-5617caf10dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2dceaec-32ca-4da8-b2ba-5617caf10dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a65c1d-be2b-47dc-af9f-6302216d7664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a65c1d-be2b-47dc-af9f-6302216d7664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513f93fc-9573-4d59-a965-3b6a53dc00c4', 'volume_name': 'volume-513f93fc-9573-4d59-a965-3b6a53dc00c4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51d4639-471e-4f03-b7c6-f110e9f4c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51d4639-471e-4f03-b7c6-f110e9f4c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ac4a61-f810-41be-9b56-dd9ed92593e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Volume 513f93fc-9573-4d59-a965-3b6a53dc00c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513f93fc-9573-4d59-a965-3b6a53dc00c4', 'volume_size': 1}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1902810172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513f93fc-9573-4d59-a965-3b6a53dc00c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f829c277283f4df2b2a92a261c7953d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:57Z,use_quota=True,user_id='b9ee5f1ec13f45969d8da9d057b80a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d7903d1-0347-49d4-b57b-1d125704f66d),volume_type_id=4d7903d1-0347-49d4-b57b-1d125704f66d)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Creating volume 513f93fc-9573-4d59-a965-3b6a53dc00c4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:57 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:57 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 1073741824
Sep 12 21:00:57 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Flow 'volume_create_manager' (8ef1f9e1-5566-4cd2-ba0c-e3db39933620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb3154c-e7ab-4efe-8055-27e32381a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb3154c-e7ab-4efe-8055-27e32381a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1106142990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0969a3-d67e-4e35-9a2c-1735313fbe89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6f00970a334617a87005fc4689dc76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:58Z,use_quota=True,user_id='f4ca7273cde44b22aee1a56d504028f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04455b2a-9718-47e3-8904-b0605d7a71f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04455b2a-9718-47e3-8904-b0605d7a71f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9451c8c5-b827-44b4-b1ce-5da838e3a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9451c8c5-b827-44b4-b1ce-5da838e3a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0969a3-d67e-4e35-9a2c-1735313fbe89', 'volume_name': 'volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4ce78a-e838-4041-93ed-34228794bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4ce78a-e838-4041-93ed-34228794bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb289f8-841b-4de9-8ec1-f71e94f96bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Volume 2d0969a3-d67e-4e35-9a2c-1735313fbe89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89', 'volume_size': 1}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:57 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 1073741824" returned: 0 in 0.657s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:57 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4
Sep 12 21:00:57 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Flow 'volume_create_manager' (c4cacecd-8836-453e-842f-2a9421987270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f2efc3-db4c-4d36-ab8a-5e7aec90ce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f2efc3-db4c-4d36-ab8a-5e7aec90ce84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-702173884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb83dd1-db75-4d65-a832-d471a2762957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dd24c17807440584f86db404d79feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:58Z,use_quota=True,user_id='e8bbab724b854781a4fadddf2b022b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ae7988-6303-4ae6-a9fb-a033ed5dbece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ae7988-6303-4ae6-a9fb-a033ed5dbece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fb7690-cfdb-41d3-9e57-f2eb686b3b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02fb7690-cfdb-41d3-9e57-f2eb686b3b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb83dd1-db75-4d65-a832-d471a2762957', 'volume_name': 'volume-efb83dd1-db75-4d65-a832-d471a2762957', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221e4d9e-c4c5-4bf1-9321-e9ee1a2ec7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221e4d9e-c4c5-4bf1-9321-e9ee1a2ec7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da2e431-8ca8-4b9d-af43-ecc5b6237ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Volume efb83dd1-db75-4d65-a832-d471a2762957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb83dd1-db75-4d65-a832-d471a2762957', 'volume_size': 1}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:58 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1106142990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0969a3-d67e-4e35-9a2c-1735313fbe89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6f00970a334617a87005fc4689dc76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:58Z,use_quota=True,user_id='f4ca7273cde44b22aee1a56d504028f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Creating volume 2d0969a3-d67e-4e35-9a2c-1735313fbe89 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ac4a61-f810-41be-9b56-dd9ed92593e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513f93fc-9573-4d59-a965-3b6a53dc00c4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack sudo[96521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 1073741824
Sep 12 21:00:58 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d94ba39-53ae-4f92-8a57-6de187d6d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Volume volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 (513f93fc-9573-4d59-a965-3b6a53dc00c4): created successfully
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d94ba39-53ae-4f92-8a57-6de187d6d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Flow 'volume_create_manager' (e7d8d3a4-0e24-4924-a541-9222520b48a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-344a23f9-736b-47d2-981f-bece35feded9 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Created volume successfully.
Sep 12 21:00:58 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 1073741824" returned: 0 in 0.417s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:58 devstack sudo[96527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89
Sep 12 21:00:58 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:58 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-702173884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb83dd1-db75-4d65-a832-d471a2762957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18dd24c17807440584f86db404d79feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:00:58Z,use_quota=True,user_id='e8bbab724b854781a4fadddf2b022b02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Creating volume efb83dd1-db75-4d65-a832-d471a2762957 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb289f8-841b-4de9-8ec1-f71e94f96bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack sudo[96530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 1073741824
Sep 12 21:00:58 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e79440-6533-46db-8530-bc6d4f849ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Volume volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 (2d0969a3-d67e-4e35-9a2c-1735313fbe89): created successfully
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e79440-6533-46db-8530-bc6d4f849ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Flow 'volume_create_manager' (8ef1f9e1-5566-4cd2-ba0c-e3db39933620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9dfa4027-84bb-4f8b-be8c-427a484d619f tempest-VolumesNegativeTest-2060116314 None] Created volume successfully.
Sep 12 21:00:59 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 1073741824" returned: 0 in 0.457s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:59 devstack sudo[96535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957
Sep 12 21:00:59 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:00:59 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da2e431-8ca8-4b9d-af43-ecc5b6237ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb83dd1-db75-4d65-a832-d471a2762957', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fef6bfe-cf65-4d71-94d7-6a195662c24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:00:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Volume volume-efb83dd1-db75-4d65-a832-d471a2762957 (efb83dd1-db75-4d65-a832-d471a2762957): created successfully
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fef6bfe-cf65-4d71-94d7-6a195662c24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Flow 'volume_create_manager' (c4cacecd-8836-453e-842f-2a9421987270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:00:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a5b2662a-3564-48bd-892c-b3489e2ad426 tempest-AttachVolumeTestJSON-2142455472 None] Created volume successfully.
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:00:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:00:59 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:00:59 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:00 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.315s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:00 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f3164516-ef50-4ef8-9089-cdaba63565ea tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Retype volume completed successfully.
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb124c-bc9a-42bf-bccc-50f72f121fef]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Acquiring lock "cinder-513f93fc-9573-4d59-a965-3b6a53dc00c4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:01 devstack sudo[96586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957
Sep 12 21:01:01 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "cinder-513f93fc-9573-4d59-a965-3b6a53dc00c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Acquiring lock "cinder-quobyte-513f93fc-9573-4d59-a965-3b6a53dc00c4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "cinder-quobyte-513f93fc-9573-4d59-a965-3b6a53dc00c4" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa8101d-d05f-4d36-9726-dd1da7006e4f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:01 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4
Sep 12 21:01:01 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:01 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.429s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-efb83dd1-db75-4d65-a832-d471a2762957', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '017f37bc-947a-4eb3-a1e6-cc734761951b', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:01:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-d6c52ad7-78fc-4792-b4a5-b118589ba44d req-8d834c42-2c55-44b6-b441-62ea4e66eb51 tempest-AttachVolumeTestJSON-2142455472 None] attachment_update completed successfully.
Sep 12 21:01:01 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4" returned: 0 in 0.464s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:01 devstack sudo[96601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4
Sep 12 21:01:01 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:02 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-513f93fc-9573-4d59-a965-3b6a53dc00c4" returned: 0 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "cinder-quobyte-513f93fc-9573-4d59-a965-3b6a53dc00c4" released by "delete_volume" :: held 0.869s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:02 devstack cinder-volume[87624]: WARNING cinder.quota [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:01:02 devstack cinder-volume[87624]: WARNING cinder.quota [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Created reservations ['faed3f75-43f2-4b7a-8cab-6a979aade804', 'f09281d3-db25-45e9-a3ba-510bb6939ddb', '2190bf60-1c2d-4110-bd31-f9f84635826f', 'fc1f9fef-b465-440a-80e7-ad3db0cb8009'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:02 devstack sudo[96605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:02 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:02 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.393s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Deleted volume successfully.
Sep 12 21:01:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7732b34b-4b25-422f-84df-26d5286f8342 tempest-VolumeRetypeWithoutMigrationTest-1779124736 None] Lock "cinder-513f93fc-9573-4d59-a965-3b6a53dc00c4-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-aefe5b31-c58a-4e2e-a830-5991e45117b2 req-7d148e44-e4bf-4adb-8e4c-c606529d6fda tempest-AttachVolumeTestJSON-2142455472 None] Terminate volume connection completed successfully.
Sep 12 21:01:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-aefe5b31-c58a-4e2e-a830-5991e45117b2 req-7d148e44-e4bf-4adb-8e4c-c606529d6fda tempest-AttachVolumeTestJSON-2142455472 None] Deleting attachment 91cefa94-b451-48ef-aaaf-cc11940aa57f. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:01:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-a1ac6a62-a26b-4398-9068-b6706050c62b req-545a4b8c-80c1-4473-8665-53200caf1de1 tempest-AttachVolumeTestJSON-2142455472 None] Terminate volume connection completed successfully.
Sep 12 21:01:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a1ac6a62-a26b-4398-9068-b6706050c62b req-545a4b8c-80c1-4473-8665-53200caf1de1 tempest-AttachVolumeTestJSON-2142455472 None] Deleting attachment 017f37bc-947a-4eb3-a1e6-cc734761951b. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Flow 'volume_create_manager' (2ca4b12e-15ad-414b-a48d-7219ef6ffaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab36f4e1-5f83-4480-80d2-69aaee708af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab36f4e1-5f83-4480-80d2-69aaee708af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-231848774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285bee01-f1de-49f7-b7ae-355c595c729a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f95bd17802442584cde7b2be566f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:13Z,use_quota=True,user_id='bad82e07f3664622b72960608f97bf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b5408e-8b98-4f84-a58a-34e30aa97916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b5408e-8b98-4f84-a58a-34e30aa97916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291aee81-0465-4a82-bd09-8589e229899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291aee81-0465-4a82-bd09-8589e229899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285bee01-f1de-49f7-b7ae-355c595c729a', 'volume_name': 'volume-285bee01-f1de-49f7-b7ae-355c595c729a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3245d9-f92d-4317-a5c6-78631afce183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3245d9-f92d-4317-a5c6-78631afce183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8ebc9f-5dd3-47b4-8e74-5c5266fad92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Volume 285bee01-f1de-49f7-b7ae-355c595c729a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285bee01-f1de-49f7-b7ae-355c595c729a', 'volume_size': 1}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-231848774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285bee01-f1de-49f7-b7ae-355c595c729a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f95bd17802442584cde7b2be566f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:13Z,use_quota=True,user_id='bad82e07f3664622b72960608f97bf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Creating volume 285bee01-f1de-49f7-b7ae-355c595c729a {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:01:13 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:13 devstack sudo[96773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a 1073741824
Sep 12 21:01:13 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "cinder-efb83dd1-db75-4d65-a832-d471a2762957-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-efb83dd1-db75-4d65-a832-d471a2762957-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "cinder-quobyte-efb83dd1-db75-4d65-a832-d471a2762957" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-quobyte-efb83dd1-db75-4d65-a832-d471a2762957" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d34f24-6645-4742-8d74-d49b6d6141d3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:13 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957
Sep 12 21:01:13 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:13 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a 1073741824" returned: 0 in 0.533s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:13 devstack sudo[96780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a
Sep 12 21:01:13 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Flow 'volume_create_manager' (2732cccb-3106-4d35-a4f7-8e04a4e300cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef07400-5868-49c1-b597-b0a9b0ddb426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef07400-5868-49c1-b597-b0a9b0ddb426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2100126344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896450c5-796e-4fb0-ac6e-39fd1e48c64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a9830cd41845b990dcee93880823e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:14Z,use_quota=True,user_id='2a6aa585324b4bdcb0718319123e89b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d051f2-a991-430a-b88f-6d66c292127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d051f2-a991-430a-b88f-6d66c292127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:14 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdde798d-86ba-4d38-b97a-83aec63af635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdde798d-86ba-4d38-b97a-83aec63af635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896450c5-796e-4fb0-ac6e-39fd1e48c64e', 'volume_name': 'volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5549ad94-217c-440a-83ec-cbcee3caf7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5549ad94-217c-440a-83ec-cbcee3caf7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4cf212-215e-4f74-83e3-ed9fa3e9379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Volume 896450c5-796e-4fb0-ac6e-39fd1e48c64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e', 'volume_size': 1}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957" returned: 0 in 0.566s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:14 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957
Sep 12 21:01:14 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:14 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a" returned: 0 in 0.337s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2100126344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896450c5-796e-4fb0-ac6e-39fd1e48c64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a9830cd41845b990dcee93880823e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:14Z,use_quota=True,user_id='2a6aa585324b4bdcb0718319123e89b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Creating volume 896450c5-796e-4fb0-ac6e-39fd1e48c64e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:01:14 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8ebc9f-5dd3-47b4-8e74-5c5266fad92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285bee01-f1de-49f7-b7ae-355c595c729a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade5d7d5-4d2f-44fa-972b-8f5c3d3f4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:14 devstack sudo[96789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e 1073741824
Sep 12 21:01:14 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Volume volume-285bee01-f1de-49f7-b7ae-355c595c729a (285bee01-f1de-49f7-b7ae-355c595c729a): created successfully
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade5d7d5-4d2f-44fa-972b-8f5c3d3f4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Flow 'volume_create_manager' (2ca4b12e-15ad-414b-a48d-7219ef6ffaca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-28196807-5d8f-46b2-8e9d-d1c541390a6c tempest-VolumesServicesTestJSON-1449259143 None] Created volume successfully.
Sep 12 21:01:14 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-efb83dd1-db75-4d65-a832-d471a2762957" returned: 0 in 0.301s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-quobyte-efb83dd1-db75-4d65-a832-d471a2762957" released by "delete_volume" :: held 0.917s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Created reservations ['0ad77faa-94c1-48b1-96bb-3b65521bf240', '6ff691fc-aa94-44ac-985e-12c5e33a1a51', 'c4e6e877-de97-4d41-9b77-a89e38066d82', '5753dbcb-6b22-40f7-953b-d5a57c18d2da'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:14 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:14 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "cinder-ffe6a34d-9066-4ead-b7d1-05dae95e9b58-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-ffe6a34d-9066-4ead-b7d1-05dae95e9b58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "cinder-quobyte-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:14 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e 1073741824" returned: 0 in 0.564s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-quobyte-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[54593dec-ef08-4d47-8df6-1db09b8a8269]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:14 devstack sudo[96800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e
Sep 12 21:01:14 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:14 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.323s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:14 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:14 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58
Sep 12 21:01:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Deleted volume successfully.
Sep 12 21:01:14 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-39a7235a-03d7-40cb-94c3-57b30a4b7225 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-efb83dd1-db75-4d65-a832-d471a2762957-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:15 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e" returned: 0 in 0.334s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4cf212-215e-4f74-83e3-ed9fa3e9379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc17cf8-411c-49cc-af52-ae17aa9094b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:15 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" returned: 0 in 0.402s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Volume volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e (896450c5-796e-4fb0-ac6e-39fd1e48c64e): created successfully
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc17cf8-411c-49cc-af52-ae17aa9094b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Flow 'volume_create_manager' (2732cccb-3106-4d35-a4f7-8e04a4e300cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:15 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58
Sep 12 21:01:15 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-074a8099-2df5-47f8-852c-3fac91acfdd8 tempest-AttachVolumeNegativeTest-234808514 None] Created volume successfully.
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Acquiring lock "cinder-285bee01-f1de-49f7-b7ae-355c595c729a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Lock "cinder-285bee01-f1de-49f7-b7ae-355c595c729a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Acquiring lock "cinder-quobyte-285bee01-f1de-49f7-b7ae-355c595c729a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Lock "cinder-quobyte-285bee01-f1de-49f7-b7ae-355c595c729a" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:15 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" returned: 0 in 0.308s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd6a8be-6a6f-48d0-b49d-3209efb8e5f5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-quobyte-ffe6a34d-9066-4ead-b7d1-05dae95e9b58" released by "delete_volume" :: held 0.771s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Created reservations ['deeb400e-ccbe-4fb8-b842-e216dcbad7b9', '62c23a9b-99c6-4203-b526-1877a09681d2', '72315b04-b673-4c0c-9483-a255a4c016d9', 'a497a262-fd16-4c21-ba6e-40229cf3c060'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:15 devstack sudo[96812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a
Sep 12 21:01:15 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:15 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:15 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:15 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a" returned: 0 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:16 devstack sudo[96820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a
Sep 12 21:01:16 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:16 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "cinder-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.351s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Deleted volume successfully.
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5c34797-f916-4b76-93d7-fc7403637415 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-ffe6a34d-9066-4ead-b7d1-05dae95e9b58-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "cinder-quobyte-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-quobyte-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2decf4b-5514-49bd-8e02-92f73207e1d7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:16 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-285bee01-f1de-49f7-b7ae-355c595c729a" returned: 0 in 0.328s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Lock "cinder-quobyte-285bee01-f1de-49f7-b7ae-355c595c729a" released by "delete_volume" :: held 0.824s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:16 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e
Sep 12 21:01:16 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Created reservations ['6f1134e3-f559-43cd-8c2c-948cf1aafac9', '2abf0211-8728-45d5-b9cb-ed5c30947567', '4befca85-39d9-439b-b74b-cb658cfc0ba7', 'f2cc51e2-7dd5-4ae5-bd29-a8f7bbf5b368'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:16 devstack sudo[96830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:16 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:16 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.317s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Deleted volume successfully.
Sep 12 21:01:16 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" returned: 0 in 0.646s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bb4ad5ff-4db4-4d81-887c-a1bf3b42e57a tempest-VolumesServicesTestJSON-1449259143 None] Lock "cinder-285bee01-f1de-49f7-b7ae-355c595c729a-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:16 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e
Sep 12 21:01:16 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284fa61-510a-4a09-8d54-b33a210b3e64]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:17 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" returned: 0 in 0.331s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-quobyte-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e" released by "delete_volume" :: held 1.033s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Created reservations ['11d3e435-73ab-4555-a717-40785be94ffa', 'de30f206-f122-4ace-9683-ac6fd955de8c', '2ace3a0e-b07b-4695-b199-9d20a00accab', '62f00e54-904d-49e4-9f11-41b8f02bb24f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:17 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e
Sep 12 21:01:17 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:17 devstack sudo[96850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:17 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:17 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e" returned: 0 in 0.518s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.545s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '221b02b5-7883-476b-95c0-44ca79e90093', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:01:17 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.415s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Deleted volume successfully.
Sep 12 21:01:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f7b73567-74e9-4c2b-a1f5-f7988ddd1542 tempest-AttachVolumeTestJSON-2142455472 None] Lock "cinder-a3f8797d-8b9e-4b67-a04d-d8bf42a9f22e-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-a2a80c5a-c141-4906-bfa3-f7fbf1e9c81c req-00cd832d-c0d6-46d1-890b-ccbc219d7eb8 tempest-AttachVolumeNegativeTest-234808514 None] attachment_update completed successfully.
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Acquiring lock "cinder-2d0969a3-d67e-4e35-9a2c-1735313fbe89-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Lock "cinder-2d0969a3-d67e-4e35-9a2c-1735313fbe89-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Acquiring lock "cinder-quobyte-2d0969a3-d67e-4e35-9a2c-1735313fbe89" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Lock "cinder-quobyte-2d0969a3-d67e-4e35-9a2c-1735313fbe89" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a2af7-7753-4a41-9b21-59dfd34d97f4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:23 devstack sudo[97248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89
Sep 12 21:01:23 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:23 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89" returned: 0 in 0.469s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:23 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89
Sep 12 21:01:23 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:24 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d0969a3-d67e-4e35-9a2c-1735313fbe89" returned: 0 in 0.398s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Lock "cinder-quobyte-2d0969a3-d67e-4e35-9a2c-1735313fbe89" released by "delete_volume" :: held 0.921s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Created reservations ['3414b452-af41-4b8b-bdff-a726263d1d80', '6718e3ec-e5ea-4cc8-b6a6-a2dd0a7bc24f', 'f44334d0-33ca-43d2-9437-fd078091857b', '6c1864dc-7013-4cd4-929c-870e92d7ade9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:24 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:24 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:24 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.442s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Deleted volume successfully.
Sep 12 21:01:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1cd84ee9-805b-411e-ba5e-6ef5392a3542 tempest-VolumesNegativeTest-2060116314 None] Lock "cinder-2d0969a3-d67e-4e35-9a2c-1735313fbe89-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5e2d1576-7dbd-4e52-b1a2-b1db9593f29f tempest-GroupSnapshotsV319Test-2028228864 None] Group tempest-GroupSnapshotsV319Test-Group-1760356898: creating
Sep 12 21:01:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5e2d1576-7dbd-4e52-b1a2-b1db9593f29f tempest-GroupSnapshotsV319Test-2028228864 None] Group tempest-GroupSnapshotsV319Test-Group-1760356898: created successfully
Sep 12 21:01:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5e2d1576-7dbd-4e52-b1a2-b1db9593f29f tempest-GroupSnapshotsV319Test-2028228864 None] Create group completed successfully.
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Flow 'volume_create_manager' (2f319544-4378-4651-8799-a15bb91b2112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b01c0c-c6f3-4adb-966c-cefe3b32750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b01c0c-c6f3-4adb-966c-cefe3b32750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-312831007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cda1d4-40ae-43b0-8604-39a5485db056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61e5fe08d084660923b424f342751aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:32Z,use_quota=True,user_id='d802b402f01548b68456c4e884defc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e48ac5e-60f9-45c5-ad00-0ebf1611c99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e48ac5e-60f9-45c5-ad00-0ebf1611c99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe031b7-997f-42b1-a964-a1f0d038ae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe031b7-997f-42b1-a964-a1f0d038ae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15cda1d4-40ae-43b0-8604-39a5485db056', 'volume_name': 'volume-15cda1d4-40ae-43b0-8604-39a5485db056', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdce33d-7824-4c57-8dd0-c915175f6acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdce33d-7824-4c57-8dd0-c915175f6acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710c46dc-471c-41ed-ac14-cd2065203081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Volume 15cda1d4-40ae-43b0-8604-39a5485db056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15cda1d4-40ae-43b0-8604-39a5485db056', 'volume_size': 1}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-312831007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cda1d4-40ae-43b0-8604-39a5485db056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61e5fe08d084660923b424f342751aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:32Z,use_quota=True,user_id='d802b402f01548b68456c4e884defc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Creating volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:01:32 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:32 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 1073741824
Sep 12 21:01:32 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Flow 'volume_create_manager' (84d876c9-c956-43ee-a7a6-7f3dec1c0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1176a5-1b4f-4584-833a-dedfc2cb39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1176a5-1b4f-4584-833a-dedfc2cb39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714167954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=42eeaf3d-1844-45a5-9942-7c2f3717ae5f,host='devstack@QuobyteHD#QuobyteHD',id=3a23eb3b-03fe-4061-b3ab-3853e4ed937c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8fd4b3186f43d183c8cac14e1f81c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:32Z,use_quota=True,user_id='e4940bd29aa942548143ace74814253e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acbdbb5c-ae1f-4d07-834b-301ea8eaca81),volume_type_id=acbdbb5c-ae1f-4d07-834b-301ea8eaca81)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fd5f07-d45e-4645-8d5d-4b6f2cbea748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fd5f07-d45e-4645-8d5d-4b6f2cbea748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a4c23f-5aa9-4185-9c07-68a3a016be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a4c23f-5aa9-4185-9c07-68a3a016be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a23eb3b-03fe-4061-b3ab-3853e4ed937c', 'volume_name': 'volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b111cb2d-66d1-4ebc-a090-1ac5b98cb3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b111cb2d-66d1-4ebc-a090-1ac5b98cb3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b16285-5654-4c4a-9fdc-7590b3a45a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:32 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Volume 3a23eb3b-03fe-4061-b3ab-3853e4ed937c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c', 'volume_size': 1}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:32 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 1073741824" returned: 0 in 0.816s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:33 devstack sudo[97332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056
Sep 12 21:01:33 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Flow 'volume_create_manager' (43e0bb17-7d06-444d-8278-c633f8e47635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a03ae8-e5ec-4b20-9fd9-e7bc60b0b7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a03ae8-e5ec-4b20-9fd9-e7bc60b0b7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1054398203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26ebed5-e945-4daa-b175-5e07ba6350a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003c31e0d8f64538baa879fc645ba930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:33Z,use_quota=True,user_id='614e383aca6244c598d32afa06ec2603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:33 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe11375e-e6ff-402c-86ed-6fe70bdc6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe11375e-e6ff-402c-86ed-6fe70bdc6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a1eac9-a506-4680-8a4c-364156ac1720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a1eac9-a506-4680-8a4c-364156ac1720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26ebed5-e945-4daa-b175-5e07ba6350a0', 'volume_name': 'volume-b26ebed5-e945-4daa-b175-5e07ba6350a0', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01914791-888e-41b6-be44-9888d7a48372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01914791-888e-41b6-be44-9888d7a48372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1ada64-6692-469f-be41-7c7b64824656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:33 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Volume b26ebed5-e945-4daa-b175-5e07ba6350a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26ebed5-e945-4daa-b175-5e07ba6350a0', 'volume_size': 1}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:33 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056" returned: 0 in 0.445s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:33 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=42eeaf3d-1844-45a5-9942-7c2f3717ae5f,created_at=2026-09-12T19:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714167954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=42eeaf3d-1844-45a5-9942-7c2f3717ae5f,host='devstack@QuobyteHD#QuobyteHD',id=3a23eb3b-03fe-4061-b3ab-3853e4ed937c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8fd4b3186f43d183c8cac14e1f81c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:32Z,use_quota=True,user_id='e4940bd29aa942548143ace74814253e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acbdbb5c-ae1f-4d07-834b-301ea8eaca81),volume_type_id=acbdbb5c-ae1f-4d07-834b-301ea8eaca81)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Creating volume 3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:01:33 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:33 devstack sudo[97337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c 1073741824
Sep 12 21:01:33 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710c46dc-471c-41ed-ac14-cd2065203081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15cda1d4-40ae-43b0-8604-39a5485db056', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a12f560-375b-4236-9d20-53e8f99acf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:33 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Volume volume-15cda1d4-40ae-43b0-8604-39a5485db056 (15cda1d4-40ae-43b0-8604-39a5485db056): created successfully
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a12f560-375b-4236-9d20-53e8f99acf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Flow 'volume_create_manager' (2f319544-4378-4651-8799-a15bb91b2112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:33 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-165d279c-4a3c-4ef5-a99c-5a0953173135 tempest-VolumesSnapshotListTestJSON-893193196 None] Created volume successfully.
Sep 12 21:01:33 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.333s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:34 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c 1073741824" returned: 0 in 0.890s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:34 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c
Sep 12 21:01:34 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:34 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.244s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1054398203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26ebed5-e945-4daa-b175-5e07ba6350a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003c31e0d8f64538baa879fc645ba930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:33Z,use_quota=True,user_id='614e383aca6244c598d32afa06ec2603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Creating volume b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:01:34 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b16285-5654-4c4a-9fdc-7590b3a45a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c85740-6771-4723-819a-216b17066423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:34 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 1073741824
Sep 12 21:01:34 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:34 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Volume volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c (3a23eb3b-03fe-4061-b3ab-3853e4ed937c): created successfully
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c85740-6771-4723-819a-216b17066423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Flow 'volume_create_manager' (84d876c9-c956-43ee-a7a6-7f3dec1c0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d394a8de-8acf-4241-b404-14b6d6aeae2a tempest-GroupSnapshotsV319Test-2028228864 None] Created volume successfully.
Sep 12 21:01:35 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 1073741824" returned: 0 in 0.548s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:35 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0
Sep 12 21:01:35 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] GroupSnapshot 7bdb2e1a-9aee-4a88-a8b9-4a8c96e91e83: creating.
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Group snapshot 7bdb2e1a-9aee-4a88-a8b9-4a8c96e91e83: creating. {{(pid=87624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:35 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0" returned: 0 in 0.309s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.239s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Creating offline snapshot 14f43b7d-34f7-4d31-950d-4055d6e9ad2e of volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1ada64-6692-469f-be41-7c7b64824656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26ebed5-e945-4daa-b175-5e07ba6350a0', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f545225-fc53-4ec4-95e3-5f1c3a54924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3919c-ae70-419d-8fff-7773948915c2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:35 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Volume volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 (b26ebed5-e945-4daa-b175-5e07ba6350a0): created successfully
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f545225-fc53-4ec4-95e3-5f1c3a54924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Flow 'volume_create_manager' (43e0bb17-7d06-444d-8278-c633f8e47635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-15b9b3cd-17d1-49b5-8321-3e35653c6e2c tempest-SnapshotMetadataTestJSON-1148117803 None] Created volume successfully.
Sep 12 21:01:35 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056
Sep 12 21:01:35 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:36 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056" returned: 0 in 0.367s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:36 devstack sudo[97364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e 1G
Sep 12 21:01:36 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:36 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e 1G" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:36 devstack sudo[97369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:36 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:36 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.336s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:36 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e is being set with open permissions: ugo+rw
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:36 devstack sudo[97374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:36 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:36 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:37 devstack sudo[97377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info
Sep 12 21:01:37 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:37 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info" returned: 0 in 0.246s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:37 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info is being set with open permissions: ugo+rw
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:37 devstack sudo[97380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info
Sep 12 21:01:37 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:37 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.info" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.118s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Creating offline snapshot 95221859-f04b-4342-aaaa-dc7f5d4ab0b9 of volume 3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:01:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-19ba70dd-048c-4e82-8aec-35821f74d21d tempest-VolumesSnapshotListTestJSON-893193196 None] Create snapshot completed successfully
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[14456ff8-e576-4fd6-af35-c8e2e0668839]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:37 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c
Sep 12 21:01:37 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:37 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" returned: 0 in 0.379s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:38 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 1G
Sep 12 21:01:38 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:38 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 1G" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:38 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9
Sep 12 21:01:38 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:38 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9" returned: 0 in 0.331s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:38 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 21:01:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:38 devstack sudo[97422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9
Sep 12 21:01:38 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:38 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9" returned: 0 in 0.285s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:39 devstack sudo[97425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info
Sep 12 21:01:39 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:39 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:39 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:39 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info
Sep 12 21:01:39 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:39 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.info" returned: 0 in 0.260s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.737s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Creating offline snapshot f1c6c70b-a5c8-4b70-b347-4ec2e42251bb of volume b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[edee3cb4-2f3d-4828-8443-9f95d3d58474]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-654f882b-7ab1-4752-908a-f0d25414044e tempest-GroupSnapshotsV319Test-2028228864 None] group_snapshot 7bdb2e1a-9aee-4a88-a8b9-4a8c96e91e83: created successfully
Sep 12 21:01:39 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0
Sep 12 21:01:39 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:40 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0" returned: 0 in 0.421s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:40 devstack sudo[97436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb 1G
Sep 12 21:01:40 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:40 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb 1G" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:40 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb
Sep 12 21:01:40 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:40 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" returned: 0 in 0.292s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:40 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb is being set with open permissions: ugo+rw
Sep 12 21:01:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:40 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb
Sep 12 21:01:40 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:41 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:41 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info
Sep 12 21:01:41 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] group_snapshot 7bdb2e1a-9aee-4a88-a8b9-4a8c96e91e83: deleting
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] group_snapshot 7bdb2e1a-9aee-4a88-a8b9-4a8c96e91e83: deleting {{(pid=87624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "cinder-quobyte-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "cinder-quobyte-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "cinder-quobyte-95221859-f04b-4342-aaaa-dc7f5d4ab0b9" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "cinder-quobyte-95221859-f04b-4342-aaaa-dc7f5d4ab0b9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Deleting offline snapshot 95221859-f04b-4342-aaaa-dc7f5d4ab0b9 of volume 3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] snapshot_file for this snap is: volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6f70b-4b66-4063-86cd-14932138cbe2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:41 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:41 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info is being set with open permissions: ugo+rw
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:41 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info
Sep 12 21:01:41 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:41 devstack sudo[97451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9
Sep 12 21:01:41 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:41 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.info" returned: 0 in 0.265s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.859s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Creating offline snapshot 4f97deeb-2025-4db5-a26f-c9ad19fa8598 of volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:01:41 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9342069d-eded-4da7-bea2-aa4b812c4e73]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9" returned: 0 in 0.438s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fc5742-07c6-45db-97c4-8a87f273a6fb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7058bdbd-0bf8-4d4a-a2f9-be926e4914c7 tempest-SnapshotMetadataTestJSON-1148117803 None] Create snapshot completed successfully
Sep 12 21:01:41 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:41 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:41 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c
Sep 12 21:01:41 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:42 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.468s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:42 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" returned: 0 in 0.449s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:42 devstack sudo[97472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 1G
Sep 12 21:01:42 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:42 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9
Sep 12 21:01:42 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:42 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9" returned: 0 in 0.453s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:42 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9
Sep 12 21:01:42 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:42 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 1G" returned: 0 in 0.643s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:42 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:42 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "cinder-f1c6c70b-a5c8-4b70-b347-4ec2e42251bb-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-f1c6c70b-a5c8-4b70-b347-4ec2e42251bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "cinder-quobyte-b26ebed5-e945-4daa-b175-5e07ba6350a0" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-quobyte-b26ebed5-e945-4daa-b175-5e07ba6350a0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "cinder-quobyte-f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-quobyte-f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Deleting offline snapshot f1c6c70b-a5c8-4b70-b347-4ec2e42251bb of volume b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] snapshot_file for this snap is: volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:01:43 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c.95221859-f04b-4342-aaaa-dc7f5d4ab0b9" returned: 0 in 0.473s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0b22a-3541-4982-b5fb-6e8cbccdc63b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "cinder-quobyte-95221859-f04b-4342-aaaa-dc7f5d4ab0b9" released by "_delete_snapshot" :: held 1.965s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "cinder-quobyte-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" released by "delete_snapshot" :: held 1.995s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:43 devstack cinder-volume[87624]: WARNING cinder.quota [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2107919204 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2107919204, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:01:43 devstack cinder-volume[87624]: WARNING cinder.quota [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2107919204 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2107919204, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:01:43 devstack sudo[97490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb
Sep 12 21:01:43 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:43 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.470s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:43 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 is being set with open permissions: ugo+rw
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] Created reservations ['bdcc5cb9-b5a7-4921-bbf3-903409bc7d13', '13674c5a-adc9-4bf9-bc4c-dead0b2c76ba', '17f6ef7f-7430-4863-92e7-d36c43720e43', 'e422dcc4-be31-4d62-a82d-c733a2b013aa'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:43 devstack sudo[97494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:43 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-da4a4df1-5229-4b25-a2a9-676da5393284 tempest-GroupSnapshotsV319Test-2028228864 None] group_snapshot 7bdb2e1a-9aee-4a88-a8b9-4a8c96e91e83: deleted successfully
Sep 12 21:01:43 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" returned: 0 in 0.440s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26ebed5-e945-4daa-b175-5e07ba6350a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:43 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.345s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0384e6-192a-458e-9a54-124e03d1920c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a90724ed-f238-4ed9-af33-a5b09e2d2573 tempest-VolumesSnapshotListTestJSON-893193196 None] Create snapshot completed successfully
Sep 12 21:01:43 devstack sudo[97520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0
Sep 12 21:01:43 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "cinder-quobyte-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "cinder-quobyte-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cd6175-0454-46ad-abf5-a1c20f3ca76c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:44 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0" returned: 0 in 0.565s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:44 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c
Sep 12 21:01:44 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:44 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb
Sep 12 21:01:44 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Creating offline snapshot 9057e0b0-90fa-4cb3-b076-be7453af1e09 of volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a00a57-bacd-4e67-8b8e-e5543c03f3cd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:44 devstack sudo[97529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:44 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:44 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:44 devstack sudo[97537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c
Sep 12 21:01:44 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:44 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" returned: 0 in 0.390s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:44 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb
Sep 12 21:01:44 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:44 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.414s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:44 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:44 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 1G
Sep 12 21:01:44 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" returned: 0 in 0.275s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "cinder-quobyte-3a23eb3b-03fe-4061-b3ab-3853e4ed937c" released by "delete_volume" :: held 0.823s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=107,cinder:INSERT=21,cinder:UPDATE=122,cinder:DELETE=10 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=116,cinder:INSERT=28,cinder:UPDATE=112,cinder:DELETE=11 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:01:44 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Created reservations ['568026ec-e170-4880-b3e5-322ea1584ffe'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0.f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" returned: 0 in 0.287s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-quobyte-f1c6c70b-a5c8-4b70-b347-4ec2e42251bb" released by "_delete_snapshot" :: held 1.857s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-quobyte-b26ebed5-e945-4daa-b175-5e07ba6350a0" released by "delete_snapshot" :: held 1.888s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:45 devstack cinder-volume[87624]: WARNING cinder.quota [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2107919204 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2107919204, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Created reservations ['f73e63c0-649d-4e4d-8a8b-28e7473fd964', '78976598-ca48-4523-8402-4b3ce64d84db', '5d537266-4efe-42d3-8143-b0579f4b81c2', '420b9bb9-2bbe-46c2-890b-7637e6611a1a'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Created reservations ['62db25ed-3382-47fd-a80d-a6e8062250ac', 'a9cf5cec-c2fe-4d52-95f1-428ce2b35714', 'aa565216-6e5d-4c9f-8f16-cacab58bc745', '4d63f0cb-2534-44d3-a34b-60e397456acf'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Delete snapshot completed successfully.
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7d10da1-d8ea-45b3-96d1-540ada3e6bb4 tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-f1c6c70b-a5c8-4b70-b347-4ec2e42251bb-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:45 devstack sudo[97552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:45 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "cinder-b26ebed5-e945-4daa-b175-5e07ba6350a0-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-b26ebed5-e945-4daa-b175-5e07ba6350a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:45 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "cinder-quobyte-b26ebed5-e945-4daa-b175-5e07ba6350a0" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 1G" returned: 0 in 0.601s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-quobyte-b26ebed5-e945-4daa-b175-5e07ba6350a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:45 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09
Sep 12 21:01:45 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb1b2d-6741-4a91-a0f6-79201ff2be88]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:45 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ae171131-3e94-4619-8895-cc33bc465a76 tempest-GroupSnapshotsV319Test-2028228864 None] Delete group completed successfully.
Sep 12 21:01:45 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0
Sep 12 21:01:45 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:45 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09" returned: 0 in 0.310s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:45 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 is being set with open permissions: ugo+rw
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:45 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09
Sep 12 21:01:45 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:45 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:45 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0
Sep 12 21:01:45 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:45 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e61e87d6-6de1-4e51-aae1-211a0948cb42 tempest-VolumesSnapshotListTestJSON-893193196 None] Create snapshot completed successfully
Sep 12 21:01:46 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b26ebed5-e945-4daa-b175-5e07ba6350a0" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-quobyte-b26ebed5-e945-4daa-b175-5e07ba6350a0" released by "delete_volume" :: held 0.707s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Created reservations ['0aa4eebe-f33c-461d-a128-46a40d3afaed', 'a63a79d2-a8b5-4ebd-9bad-e71b0639fba0', 'df84c2d7-7dad-4990-8531-7a91bda18576', '6a57144c-a8e2-4969-a659-ef7d99aeb5a8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:46 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:46 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:46 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.253s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Deleted volume successfully.
Sep 12 21:01:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7f487c14-d22c-4d18-8057-a1d9eea5dddd tempest-SnapshotMetadataTestJSON-1148117803 None] Lock "cinder-b26ebed5-e945-4daa-b175-5e07ba6350a0-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-9057e0b0-90fa-4cb3-b076-be7453af1e09-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-9057e0b0-90fa-4cb3-b076-be7453af1e09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-9057e0b0-90fa-4cb3-b076-be7453af1e09" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-9057e0b0-90fa-4cb3-b076-be7453af1e09" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Deleting offline snapshot 9057e0b0-90fa-4cb3-b076-be7453af1e09 of volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] snapshot_file for this snap is: volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22f5809-2f89-427a-92e0-4e91de2f088c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:47 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09
Sep 12 21:01:47 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:47 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09" returned: 0 in 0.424s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdf0168-8d0f-4270-8f6d-017ba7d0f8bd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:48 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:48 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:48 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.404s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:48 devstack sudo[97585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09
Sep 12 21:01:48 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:48 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09" returned: 0 in 0.519s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:48 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09
Sep 12 21:01:48 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:49 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.9057e0b0-90fa-4cb3-b076-be7453af1e09" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-9057e0b0-90fa-4cb3-b076-be7453af1e09" released by "_delete_snapshot" :: held 1.762s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" released by "delete_snapshot" :: held 1.791s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Created reservations ['503e02f5-68ef-46cd-87d9-e3cd6069dffe', '077e8335-8ae4-40e9-b3f9-3ae85106653e', '6c7c8743-a5cf-493d-a232-df2adc53e2c7', 'fb5bb0cf-e9af-4e2b-9970-8487455bbac2'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Delete snapshot completed successfully.
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a7ead640-0e59-49a1-81d6-5203753de8b1 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-9057e0b0-90fa-4cb3-b076-be7453af1e09-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-4f97deeb-2025-4db5-a26f-c9ad19fa8598-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-4f97deeb-2025-4db5-a26f-c9ad19fa8598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-4f97deeb-2025-4db5-a26f-c9ad19fa8598" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-4f97deeb-2025-4db5-a26f-c9ad19fa8598" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Deleting offline snapshot 4f97deeb-2025-4db5-a26f-c9ad19fa8598 of volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] snapshot_file for this snap is: volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f432ac-effe-4c1d-82bb-4cdf0c1edefb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:49 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:49 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:50 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.423s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[260c6258-f39c-4f7c-aaa0-9e32380f2148]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:50 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:50 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:50 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.429s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:50 devstack sudo[97608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:50 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:51 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.560s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:51 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598
Sep 12 21:01:51 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:51 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.4f97deeb-2025-4db5-a26f-c9ad19fa8598" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-4f97deeb-2025-4db5-a26f-c9ad19fa8598" released by "_delete_snapshot" :: held 1.858s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" released by "delete_snapshot" :: held 1.887s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Created reservations ['58aa7574-4f66-4171-b81f-cafd9c22a22e', '50485094-6f6e-4260-8be9-e29da05c72b5', '44969f52-b46a-4606-bdb3-eb8aaa2fb582', 'a88afbb6-e895-4cfd-8dbc-ad8a7c4d1f36'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Delete snapshot completed successfully.
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2f05b19-32ce-47f4-b9c3-6e4dc2dd4b4a tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-4f97deeb-2025-4db5-a26f-c9ad19fa8598-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-14f43b7d-34f7-4d31-950d-4055d6e9ad2e-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-14f43b7d-34f7-4d31-950d-4055d6e9ad2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-14f43b7d-34f7-4d31-950d-4055d6e9ad2e" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-14f43b7d-34f7-4d31-950d-4055d6e9ad2e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Deleting offline snapshot 14f43b7d-34f7-4d31-950d-4055d6e9ad2e of volume 15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] snapshot_file for this snap is: volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[47802eb1-0abd-44dc-ad04-05ffb8009d9b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:52 devstack sudo[97627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:52 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:52 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.551s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cda1d4-40ae-43b0-8604-39a5485db056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e32f3-eb6e-4b60-8207-e13224d1326f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:52 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Flow 'volume_create_manager' (6fb423f6-ced1-4512-b905-ba9a3dda9a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd87917-e477-4df6-90b9-1d764d3d8e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:53 devstack sudo[97642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056
Sep 12 21:01:53 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd87917-e477-4df6-90b9-1d764d3d8e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-332487480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882be0c-8a10-4cca-9c75-652b060d2a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3af41ccf7d040f39bfd4b5d3d183ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:53Z,use_quota=True,user_id='8e9b1e559dc34e619e5acf0cabf28bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df66857-bf96-4717-b5c5-7b07ff64a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df66857-bf96-4717-b5c5-7b07ff64a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201774e1-a32e-4c52-8f9b-7381367d267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201774e1-a32e-4c52-8f9b-7381367d267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8882be0c-8a10-4cca-9c75-652b060d2a7b', 'volume_name': 'volume-8882be0c-8a10-4cca-9c75-652b060d2a7b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129e9298-84ec-4060-9bf8-75b71954631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129e9298-84ec-4060-9bf8-75b71954631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82e74fb-a9d0-4b87-a49a-7d352f956f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Volume 8882be0c-8a10-4cca-9c75-652b060d2a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8882be0c-8a10-4cca-9c75-652b060d2a7b', 'volume_size': 1}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-332487480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882be0c-8a10-4cca-9c75-652b060d2a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3af41ccf7d040f39bfd4b5d3d183ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:01:53Z,use_quota=True,user_id='8e9b1e559dc34e619e5acf0cabf28bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Creating volume 8882be0c-8a10-4cca-9c75-652b060d2a7b {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:01:53 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:53 devstack sudo[97644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b 1073741824
Sep 12 21:01:53 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:53 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056" returned: 0 in 0.565s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:53 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:53 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:53 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b 1073741824" returned: 0 in 0.531s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:53 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:53 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b
Sep 12 21:01:53 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:53 devstack sudo[97659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e
Sep 12 21:01:53 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:53 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:01:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82e74fb-a9d0-4b87-a49a-7d352f956f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8882be0c-8a10-4cca-9c75-652b060d2a7b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1443db-c0bb-47c7-8ec7-5937a669bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:01:54 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Volume volume-8882be0c-8a10-4cca-9c75-652b060d2a7b (8882be0c-8a10-4cca-9c75-652b060d2a7b): created successfully
Sep 12 21:01:54 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1443db-c0bb-47c7-8ec7-5937a669bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Flow 'volume_create_manager' (6fb423f6-ced1-4512-b905-ba9a3dda9a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056.14f43b7d-34f7-4d31-950d-4055d6e9ad2e" returned: 0 in 0.318s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7e59a706-9504-435f-82f8-1a09785ef65f tempest-AbsoluteLimitsTests-1742560489 None] Created volume successfully.
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-14f43b7d-34f7-4d31-950d-4055d6e9ad2e" released by "_delete_snapshot" :: held 2.063s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" released by "delete_snapshot" :: held 2.100s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Created reservations ['420a7350-6c52-40d4-9a52-dbcfcb9ca12b', '860bedf2-0c86-49cd-9caa-071b46ec2616', 'b3e01c30-41e2-4654-b5e2-18e327d14e80', '6c6c054d-5f2b-4608-a2af-006c0a3c64b9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Delete snapshot completed successfully.
Sep 12 21:01:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2f4faa7d-3d90-4e17-a673-b71adbbeb44c tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-14f43b7d-34f7-4d31-950d-4055d6e9ad2e-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-15cda1d4-40ae-43b0-8604-39a5485db056-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Acquiring lock "cinder-8882be0c-8a10-4cca-9c75-652b060d2a7b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-15cda1d4-40ae-43b0-8604-39a5485db056-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Lock "cinder-8882be0c-8a10-4cca-9c75-652b060d2a7b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Acquiring lock "cinder-quobyte-8882be0c-8a10-4cca-9c75-652b060d2a7b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Lock "cinder-quobyte-8882be0c-8a10-4cca-9c75-652b060d2a7b" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e28021-927d-4b21-ab7e-e2a247c246d2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[582092c9-567a-4ba0-9c7d-1c5f66fb04ab]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:01:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:55 devstack sudo[97688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056
Sep 12 21:01:55 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:55 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b
Sep 12 21:01:55 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:56 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056" returned: 0 in 0.513s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:56 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056
Sep 12 21:01:56 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:56 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b" returned: 0 in 0.591s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:56 devstack sudo[97702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b
Sep 12 21:01:56 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-15cda1d4-40ae-43b0-8604-39a5485db056" returned: 0 in 0.392s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:56 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-quobyte-15cda1d4-40ae-43b0-8604-39a5485db056" released by "delete_volume" :: held 1.076s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:56 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8882be0c-8a10-4cca-9c75-652b060d2a7b" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Lock "cinder-quobyte-8882be0c-8a10-4cca-9c75-652b060d2a7b" released by "delete_volume" :: held 1.076s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Created reservations ['9ed2ee74-13e2-49bf-96dd-1902f847fbd8', '461c90f6-9418-4ba6-b00c-340540e0011e', 'a1e39788-6e1c-409a-883d-87a785007d24', 'cf37ce28-51b0-4af4-bc30-a0757ed3acb8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Created reservations ['6b515949-39ea-4a19-9299-de5712b3e667', '964bd8b2-7a82-42cf-89d1-367816ab60b6', '8734bd4a-5dad-4220-955d-6fc2de8ddae2', '394ddaaf-c585-4335-b270-baebf8e85d58'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:57 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:57 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:01:57 devstack sudo[97744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:01:57 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:01:57 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Deleted volume successfully.
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79f2d905-6d0d-4cb6-95a9-929d20b13a87 tempest-VolumesSnapshotListTestJSON-893193196 None] Lock "cinder-15cda1d4-40ae-43b0-8604-39a5485db056-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:01:57 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:01:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Deleted volume successfully.
Sep 12 21:01:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-dd79989b-069d-48d9-bc0d-14bf7e1addc0 tempest-AbsoluteLimitsTests-1742560489 None] Lock "cinder-8882be0c-8a10-4cca-9c75-652b060d2a7b-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-d201d9c5-4342-4723-8e39-e5363b2827e6 req-2a874c71-532e-488c-b104-565a21364237 tempest-AttachVolumeNegativeTest-234808514 None] Terminate volume connection completed successfully.
Sep 12 21:02:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-d201d9c5-4342-4723-8e39-e5363b2827e6 req-2a874c71-532e-488c-b104-565a21364237 tempest-AttachVolumeNegativeTest-234808514 None] Deleting attachment 221b02b5-7883-476b-95c0-44ca79e90093. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:02:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ec37fa8b-c27f-4b48-9aff-23d532e86a18 tempest-GroupsV314Test-306453798 None] Group tempest-GroupsV314Test-Group-1802275278: creating
Sep 12 21:02:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ec37fa8b-c27f-4b48-9aff-23d532e86a18 tempest-GroupsV314Test-306453798 None] Group tempest-GroupsV314Test-Group-1802275278: created successfully
Sep 12 21:02:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ec37fa8b-c27f-4b48-9aff-23d532e86a18 tempest-GroupsV314Test-306453798 None] Create group completed successfully.
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Flow 'volume_create_manager' (93c27321-07f3-430c-b45f-934cf7e15113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b436ef8e-8105-4520-b754-a42065ca90b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b436ef8e-8105-4520-b754-a42065ca90b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087142717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d6124ae-11cc-40bb-ad43-30e0e6907a47,host='devstack@QuobyteHD#QuobyteHD',id=c6ec5a9a-367e-4834-b5c4-0dca1ea55df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2bcd4140b844ccac6499ecb4fa202c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:04Z,use_quota=True,user_id='ec558c9969894dd19bdf577763eee524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb47145f-5a60-4d7b-ac09-1b62becbaa8c),volume_type_id=fb47145f-5a60-4d7b-ac09-1b62becbaa8c)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5639ed8e-af27-41bd-bfa4-01afdec40052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5639ed8e-af27-41bd-bfa4-01afdec40052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4f323-634b-4baf-bbe9-6bad084fb56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b4f323-634b-4baf-bbe9-6bad084fb56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ec5a9a-367e-4834-b5c4-0dca1ea55df1', 'volume_name': 'volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a013b5c7-4f7f-474e-bf9e-27d8b31e7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a013b5c7-4f7f-474e-bf9e-27d8b31e7519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cee452d-33bd-424d-bf7e-de5f43bebe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Volume c6ec5a9a-367e-4834-b5c4-0dca1ea55df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1', 'volume_size': 1}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d6124ae-11cc-40bb-ad43-30e0e6907a47,created_at=2026-09-12T19:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087142717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d6124ae-11cc-40bb-ad43-30e0e6907a47,host='devstack@QuobyteHD#QuobyteHD',id=c6ec5a9a-367e-4834-b5c4-0dca1ea55df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2bcd4140b844ccac6499ecb4fa202c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:04Z,use_quota=True,user_id='ec558c9969894dd19bdf577763eee524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb47145f-5a60-4d7b-ac09-1b62becbaa8c),volume_type_id=fb47145f-5a60-4d7b-ac09-1b62becbaa8c)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Creating volume c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:02:04 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:02:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:04 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 1073741824
Sep 12 21:02:04 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:05 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 1073741824" returned: 0 in 0.618s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:05 devstack sudo[97783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:05 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Flow 'volume_create_manager' (8fa183f7-445e-4524-9f95-e7cf9f75c2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109869f3-dfb1-4299-ab06-41929abfb3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109869f3-dfb1-4299-ab06-41929abfb3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1045329624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57d2e65-7606-49b5-83ee-09be1bebaa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257c3af07f364c31ba4b2d28e268e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:05Z,use_quota=True,user_id='7ac5d3c102e446278fea4625d17122d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc40c3a4-24bc-4e3d-affc-370949be107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc40c3a4-24bc-4e3d-affc-370949be107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b75d07-bf09-4687-96be-1a18792adb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b75d07-bf09-4687-96be-1a18792adb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57d2e65-7606-49b5-83ee-09be1bebaa63', 'volume_name': 'volume-e57d2e65-7606-49b5-83ee-09be1bebaa63', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15cb73f-1966-4352-8e17-86e4e3f7341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15cb73f-1966-4352-8e17-86e4e3f7341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1161e288-e3dc-4000-ac23-376f64f9a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:05 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Volume e57d2e65-7606-49b5-83ee-09be1bebaa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57d2e65-7606-49b5-83ee-09be1bebaa63', 'volume_size': 1}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:05 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.450s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1045329624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57d2e65-7606-49b5-83ee-09be1bebaa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257c3af07f364c31ba4b2d28e268e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:05Z,use_quota=True,user_id='7ac5d3c102e446278fea4625d17122d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Creating volume e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:02:05 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cee452d-33bd-424d-bf7e-de5f43bebe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:05 devstack sudo[97786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 1073741824
Sep 12 21:02:05 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bf17aa-a7e3-428f-859c-30f9e543c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:05 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Volume volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 (c6ec5a9a-367e-4834-b5c4-0dca1ea55df1): created successfully
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bf17aa-a7e3-428f-859c-30f9e543c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Flow 'volume_create_manager' (93c27321-07f3-430c-b45f-934cf7e15113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5336ecd0-ae97-4d45-9e79-314191ac958a tempest-GroupsV314Test-306453798 None] Created volume successfully.
Sep 12 21:02:06 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 1073741824" returned: 0 in 0.514s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:06 devstack sudo[97791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:06 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:06 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.274s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1161e288-e3dc-4000-ac23-376f64f9a67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57d2e65-7606-49b5-83ee-09be1bebaa63', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9fa654-cf61-4685-808b-4119c744de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:06 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Volume volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 (e57d2e65-7606-49b5-83ee-09be1bebaa63): created successfully
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9fa654-cf61-4685-808b-4119c744de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Flow 'volume_create_manager' (8fa183f7-445e-4524-9f95-e7cf9f75c2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6df3fa04-b4d0-4b46-9422-640e158c1a85 tempest-VolumesCloneTest-1449502294 None] Created volume successfully.
Sep 12 21:02:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Cloning volume c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 to volume e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9
Sep 12 21:02:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Creating offline snapshot 70490f62-5222-4702-a8be-c09ba79883c7 of volume c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:02:07 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fde0a3-e266-4057-b02f-46edbc3d1c0c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:07 devstack sudo[97794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:07 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:08 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.565s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:08 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 1G
Sep 12 21:02:08 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Flow 'volume_create_manager' (0900113e-c2dc-4409-9722-a342b7f91f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5b7022-2f4e-4272-94fa-dca008cd0363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5b7022-2f4e-4272-94fa-dca008cd0363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1242780210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f58f702-2575-469d-a2b8-810c926044a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257c3af07f364c31ba4b2d28e268e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=e57d2e65-7606-49b5-83ee-09be1bebaa63,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:08Z,use_quota=True,user_id='7ac5d3c102e446278fea4625d17122d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cade96-9a58-4def-a268-469de8cdfe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cade96-9a58-4def-a268-469de8cdfe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e362033-984c-4ea8-a1bd-fda5308815a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e362033-984c-4ea8-a1bd-fda5308815a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7f58f702-2575-469d-a2b8-810c926044a5', 'volume_name': 'volume-7f58f702-2575-469d-a2b8-810c926044a5', 'volume_size': 2, 'source_volid': 'e57d2e65-7606-49b5-83ee-09be1bebaa63', 'source_volstatus': 'available'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ae3b9e-eecc-4058-a0e7-1df7671f13f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ae3b9e-eecc-4058-a0e7-1df7671f13f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73d2ef4-d014-48a9-a565-28ba00946b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Volume 7f58f702-2575-469d-a2b8-810c926044a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7f58f702-2575-469d-a2b8-810c926044a5', 'volume_size': 2, 'source_volid': 'e57d2e65-7606-49b5-83ee-09be1bebaa63', 'source_volstatus': 'available'}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:08 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 1G" returned: 0 in 0.529s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:08 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7
Sep 12 21:02:08 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:09 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7" returned: 0 in 0.484s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:09 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 21:02:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:09 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7
Sep 12 21:02:09 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:09 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7" returned: 0 in 0.292s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:09 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info
Sep 12 21:02:09 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:09 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info" returned: 0 in 0.275s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:09 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 21:02:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:09 devstack sudo[97816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info
Sep 12 21:02:09 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:10 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.info" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Acquiring lock "cinder-quobyte-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] snapshot: 70490f62-5222-4702-a8be-c09ba79883c7, volume: e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c36c6-f59b-4be7-a4b3-b69047fc72b0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:10 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7
Sep 12 21:02:10 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:10 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7" returned: 0 in 0.466s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8ccf6-9560-42a8-8a5f-416502b80a43]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:10 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:10 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:11 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:11 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:02:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:11 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9
Sep 12 21:02:11 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:17 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" returned: 0 in 6.231s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf1c6d3-ee69-417a-a83d-a385f6647da6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:17 devstack sudo[97865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:17 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:17 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.564s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:17 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:02:17 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Converted 1024.00 MB image at 164.23 MB/s
Sep 12 21:02:17 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 is being set with open permissions: ugo+rw: NotImplementedError
Sep 12 21:02:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:17 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9
Sep 12 21:02:17 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:18 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" returned: 0 in 0.300s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" released by "_copy_volume_from_snapshot" :: held 8.129s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Acquiring lock "cinder-quobyte-70490f62-5222-4702-a8be-c09ba79883c7" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-70490f62-5222-4702-a8be-c09ba79883c7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Deleting offline snapshot 70490f62-5222-4702-a8be-c09ba79883c7 of volume c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] snapshot_file for this snap is: volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e9e7f1-bfee-4732-bdd9-c6e190a85ebc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:18 devstack sudo[97876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7
Sep 12 21:02:18 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:18 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7" returned: 0 in 0.515s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3f676f-a564-4958-9503-92d90b7f49bb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:19 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:19 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:19 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.483s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:19 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7
Sep 12 21:02:19 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:19 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=61,cinder:INSERT=16,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:02:20 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7" returned: 0 in 0.751s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:20 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7
Sep 12 21:02:20 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:20 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1.70490f62-5222-4702-a8be-c09ba79883c7" returned: 0 in 0.443s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-70490f62-5222-4702-a8be-c09ba79883c7" released by "_delete_snapshot" :: held 2.332s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.131s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:20 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Cloning volume e57d2e65-7606-49b5-83ee-09be1bebaa63 to volume 7f58f702-2575-469d-a2b8-810c926044a5
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Creating offline snapshot f6d44c53-f72f-4276-a951-d5e1e44f56c4 of volume e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2b2d0f-8870-4ba3-9b92-b4cbd708b884]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c8edb381-4f95-4d99-9c86-5d3f4e67906f tempest-GroupsV314Test-306453798 None] Create group from source-group-0d6124ae-11cc-40bb-ad43-30e0e6907a47 completed successfully.
Sep 12 21:02:21 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:21 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:21 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.616s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:21 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 1G
Sep 12 21:02:21 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Acquiring lock "cinder-quobyte-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" acquired by "delete_volume" :: waited 0.033s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5470e24b-a006-4d60-a8ba-8187d790e2e4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:22 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 1G" returned: 0 in 0.911s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:22 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4
Sep 12 21:02:22 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:22 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9
Sep 12 21:02:22 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:22 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:22 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 is being set with open permissions: ugo+rw
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:22 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" returned: 0 in 0.588s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:22 devstack sudo[97992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4
Sep 12 21:02:22 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:22 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9
Sep 12 21:02:22 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:23 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4" returned: 0 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:23 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info
Sep 12 21:02:23 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:23 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" returned: 0 in 0.496s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-e2a3d08b-98cf-4360-9c1c-ac21ff3d95f9" released by "delete_volume" :: held 1.164s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Created reservations ['b43fbbb6-c674-4eef-ae11-663d5c661fbe'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:02:23 devstack cinder-volume[87624]: WARNING cinder.quota [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-826053341 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-826053341, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:02:23 devstack cinder-volume[87624]: WARNING cinder.quota [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-826053341 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-826053341, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Created reservations ['a76e7db5-0f31-4c32-bf27-ac61e00d61aa', '1f576831-fbae-470f-8543-e9e6834433cc', '4d003604-ac6e-46f1-8427-e1c3507ec0ee', '1b476c7c-61f2-456a-b039-bc5c88dbf06a'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:02:23 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info" returned: 0 in 0.554s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:23 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info is being set with open permissions: ugo+rw
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:23 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info
Sep 12 21:02:23 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:23 devstack sudo[98003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:02:23 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:24 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.info" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "cinder-quobyte-7f58f702-2575-469d-a2b8-810c926044a5" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-7f58f702-2575-469d-a2b8-810c926044a5" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] snapshot: f6d44c53-f72f-4276-a951-d5e1e44f56c4, volume: 7f58f702-2575-469d-a2b8-810c926044a5,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:02:24 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.377s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:02:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-30db168f-b050-4dab-ab62-a340f0c49792 tempest-GroupsV314Test-306453798 None] Delete group completed successfully.
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a9d7d-403f-458e-b57e-a3ea5af03cd4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:24 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4
Sep 12 21:02:24 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:24 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4" returned: 0 in 0.530s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57d2e65-7606-49b5-83ee-09be1bebaa63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[608bd835-e5f1-4ca4-8f12-cb2ee3b47e0f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:25 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:25 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Acquiring lock "cinder-quobyte-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" acquired by "delete_volume" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff2b960-4eab-4bbd-9d7c-72f65a625c9f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:25 devstack sudo[98016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:25 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:25 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.804s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:02:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:25 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5
Sep 12 21:02:25 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:25 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.706s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:26 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1
Sep 12 21:02:26 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:26 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" returned: 0 in 0.599s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Lock "cinder-quobyte-c6ec5a9a-367e-4834-b5c4-0dca1ea55df1" released by "delete_volume" :: held 1.427s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:26 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Created reservations ['d03082b2-a06a-4fcc-aea5-86d67de8bf05'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Created reservations ['1f1daf5e-9e82-4e4e-9003-7c1ae7f218ef', 'f5cc102c-1277-4e9b-8795-fc171940e4cb', '996db3f8-5a3c-432d-bb9b-be355c458499', '46b762f1-1dd4-45da-aa21-68132efbd1e4'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:27 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:02:28 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:28 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 1.068s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:28 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:02:28 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-58b90244-ec15-4907-a8a6-ae857f3d2316 tempest-GroupsV314Test-306453798 None] Delete group completed successfully.
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:33 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:02:33 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:34 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5" returned: 0 in 8.451s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b951d-bcf3-4297-bfb6-ffd3df94f9d6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:34 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.785s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:02:34 devstack sudo[98070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:34 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:34 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.617s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:02:34 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Converted 1024.00 MB image at 121.16 MB/s
Sep 12 21:02:34 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 is being set with open permissions: ugo+rw
Sep 12 21:02:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:34 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5
Sep 12 21:02:34 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:35 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5" returned: 0 in 0.302s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-7f58f702-2575-469d-a2b8-810c926044a5" released by "_copy_volume_from_snapshot" :: held 10.888s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "cinder-quobyte-f6d44c53-f72f-4276-a951-d5e1e44f56c4" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-f6d44c53-f72f-4276-a951-d5e1e44f56c4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Deleting offline snapshot f6d44c53-f72f-4276-a951-d5e1e44f56c4 of volume e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] snapshot_file for this snap is: volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[371df06e-f852-4ce5-a7e6-a86040a50152]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:35 devstack sudo[98078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4
Sep 12 21:02:35 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:35 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4" returned: 0 in 0.453s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57d2e65-7606-49b5-83ee-09be1bebaa63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ee1404-6c50-4bda-97ac-47f29d44c6a2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:35 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:35 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:36 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.419s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:36 devstack sudo[98090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4
Sep 12 21:02:36 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:36 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4" returned: 0 in 0.430s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:36 devstack sudo[98096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4
Sep 12 21:02:36 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:36 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63.f6d44c53-f72f-4276-a951-d5e1e44f56c4" returned: 0 in 0.301s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-f6d44c53-f72f-4276-a951-d5e1e44f56c4" released by "_delete_snapshot" :: held 1.735s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.250s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73d2ef4-d014-48a9-a565-28ba00946b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f58f702-2575-469d-a2b8-810c926044a5', 'volume_size': 2, 'source_volid': 'e57d2e65-7606-49b5-83ee-09be1bebaa63', 'source_volstatus': 'available'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751f72c6-f8fc-41d4-8460-303d26b03de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:36 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Volume volume-7f58f702-2575-469d-a2b8-810c926044a5 (7f58f702-2575-469d-a2b8-810c926044a5): created successfully
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751f72c6-f8fc-41d4-8460-303d26b03de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Flow 'volume_create_manager' (0900113e-c2dc-4409-9722-a342b7f91f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-66860ea7-49cd-47f9-83c0-2b1902df5d50 tempest-VolumesCloneTest-1449502294 None] Created volume successfully.
Sep 12 21:02:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "cinder-7f58f702-2575-469d-a2b8-810c926044a5-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-7f58f702-2575-469d-a2b8-810c926044a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "cinder-quobyte-7f58f702-2575-469d-a2b8-810c926044a5" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-7f58f702-2575-469d-a2b8-810c926044a5" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[538b4255-5c9e-4a20-a0e1-f288ebc97644]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:38 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5
Sep 12 21:02:38 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:38 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5" returned: 0 in 0.377s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:38 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5
Sep 12 21:02:38 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:38 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f58f702-2575-469d-a2b8-810c926044a5" returned: 0 in 0.260s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-7f58f702-2575-469d-a2b8-810c926044a5" released by "delete_volume" :: held 0.689s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Created reservations ['9f7b6651-d964-4267-b13e-544d0d89bd15', '4967713a-edb4-4097-a8e7-fad067bc932a', '1f4d102a-9a60-4beb-821b-70cd2f5ee105', 'ddb2e443-f1d4-4b15-a36c-74b52b5c072e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:38 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:02:38 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Flow 'volume_create_manager' (0e7aa22f-83b6-439e-a877-ac1049e656fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde8a637-8807-4927-89e5-ac43f8886399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde8a637-8807-4927-89e5-ac43f8886399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1242576856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e5219f-0929-4024-95a5-185a6490bf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6311b03ccc4e09bcbb954707dce5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:39Z,use_quota=True,user_id='f900ee6f223e4f4bb2d35249c8ac5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c612dd2d-0040-4076-af1f-d10e966a4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c612dd2d-0040-4076-af1f-d10e966a4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2e4feb-b6a4-4d10-9ff9-9ef5a7da9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2e4feb-b6a4-4d10-9ff9-9ef5a7da9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e5219f-0929-4024-95a5-185a6490bf55', 'volume_name': 'volume-47e5219f-0929-4024-95a5-185a6490bf55', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca947c51-d546-46a7-bdf6-d2630e7ef272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca947c51-d546-46a7-bdf6-d2630e7ef272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc30638-be29-4d8f-a02e-9d9f7821e8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Volume 47e5219f-0929-4024-95a5-185a6490bf55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e5219f-0929-4024-95a5-185a6490bf55', 'volume_size': 1}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1242576856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e5219f-0929-4024-95a5-185a6490bf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6311b03ccc4e09bcbb954707dce5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:39Z,use_quota=True,user_id='f900ee6f223e4f4bb2d35249c8ac5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Creating volume 47e5219f-0929-4024-95a5-185a6490bf55 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:02:39 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:39 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 1073741824
Sep 12 21:02:39 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:39 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:02:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Deleted volume successfully.
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "cinder-e57d2e65-7606-49b5-83ee-09be1bebaa63-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8d32484a-fcdb-4e96-9672-eccad2712fc4 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-7f58f702-2575-469d-a2b8-810c926044a5-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-e57d2e65-7606-49b5-83ee-09be1bebaa63-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "cinder-quobyte-e57d2e65-7606-49b5-83ee-09be1bebaa63" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-e57d2e65-7606-49b5-83ee-09be1bebaa63" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b301b08e-c077-4fe0-9c51-1a31326b72ad]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:39 devstack sudo[98112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:39 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Flow 'volume_create_manager' (14cea059-1bd0-4276-a568-9c6032da3a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7f4d5f-8f9b-444d-a139-c1cba2d11fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7f4d5f-8f9b-444d-a139-c1cba2d11fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-318903951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cb20e4-48e0-41c5-bc3c-f35e2da0523b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6311b03ccc4e09bcbb954707dce5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:40Z,use_quota=True,user_id='f900ee6f223e4f4bb2d35249c8ac5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018b1455-73c5-40af-86f8-ede8866b2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018b1455-73c5-40af-86f8-ede8866b2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195e2769-d0f6-41bd-9969-aeed5897ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195e2769-d0f6-41bd-9969-aeed5897ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26cb20e4-48e0-41c5-bc3c-f35e2da0523b', 'volume_name': 'volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914ba54a-fc42-4c71-8f35-d6f706c38582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914ba54a-fc42-4c71-8f35-d6f706c38582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c795efee-d7c9-4809-8848-37fdb2cea5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Volume 26cb20e4-48e0-41c5-bc3c-f35e2da0523b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b', 'volume_size': 1}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:39 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 1073741824" returned: 0 in 0.608s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:39 devstack sudo[98117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55
Sep 12 21:02:39 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:40 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.564s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:40 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63
Sep 12 21:02:40 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:40 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55" returned: 0 in 0.342s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.433s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-318903951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cb20e4-48e0-41c5-bc3c-f35e2da0523b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6311b03ccc4e09bcbb954707dce5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:40Z,use_quota=True,user_id='f900ee6f223e4f4bb2d35249c8ac5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Creating volume 26cb20e4-48e0-41c5-bc3c-f35e2da0523b {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:02:40 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc30638-be29-4d8f-a02e-9d9f7821e8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e5219f-0929-4024-95a5-185a6490bf55', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c1ea31-600a-4ef5-9cd6-c676850e1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:40 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b 1073741824
Sep 12 21:02:40 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Volume volume-47e5219f-0929-4024-95a5-185a6490bf55 (47e5219f-0929-4024-95a5-185a6490bf55): created successfully
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c1ea31-600a-4ef5-9cd6-c676850e1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Flow 'volume_create_manager' (0e7aa22f-83b6-439e-a877-ac1049e656fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-65e28c75-53a1-41fa-9ccf-c4349681753e tempest-TestServerVolumeAttachmentScenario-637700333 None] Created volume successfully.
Sep 12 21:02:40 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e57d2e65-7606-49b5-83ee-09be1bebaa63" returned: 0 in 0.451s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-quobyte-e57d2e65-7606-49b5-83ee-09be1bebaa63" released by "delete_volume" :: held 1.125s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Created reservations ['427ec3a3-52de-4ae4-8afa-309028ef2a86', '19f00715-54f8-4cba-b69e-fe9429953490', 'e75a7675-6025-47aa-8525-fc7cf8b52a21', '8d49a68f-9c89-4d4c-ab5b-563b0d090973'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:40 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:02:40 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:41 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b 1073741824" returned: 0 in 0.837s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:41 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b
Sep 12 21:02:41 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:41 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.447s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:02:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Deleted volume successfully.
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-11425766-2619-454b-b9a0-0dda748703c0 tempest-VolumesCloneTest-1449502294 None] Lock "cinder-e57d2e65-7606-49b5-83ee-09be1bebaa63-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:02:41 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" returned: 0 in 0.328s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c795efee-d7c9-4809-8848-37fdb2cea5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af422cc-976a-469c-b7b6-e4e970d52d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Volume volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b (26cb20e4-48e0-41c5-bc3c-f35e2da0523b): created successfully
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af422cc-976a-469c-b7b6-e4e970d52d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Flow 'volume_create_manager' (14cea059-1bd0-4276-a568-9c6032da3a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-037b46d3-0b0a-4904-b32d-c4ffcaec5e67 tempest-TestServerVolumeAttachmentScenario-637700333 None] Created volume successfully.
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=126,cinder:SELECT=96,cinder:INSERT=32,cinder:DELETE=4 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Flow 'volume_create_manager' (8217862f-a3ab-47ef-82b8-030c471610d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4eab19-6575-4b02-989b-4bf8aefb910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4eab19-6575-4b02-989b-4bf8aefb910b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-589486370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1440949d-15e9-4329-83b0-668c7e299413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a9830cd41845b990dcee93880823e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:45Z,use_quota=True,user_id='2a6aa585324b4bdcb0718319123e89b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731bfdd5-8580-4102-98bc-fa61fb23f37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731bfdd5-8580-4102-98bc-fa61fb23f37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf954fba-fa54-4339-b1e6-a4b6f97ce00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf954fba-fa54-4339-b1e6-a4b6f97ce00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1440949d-15e9-4329-83b0-668c7e299413', 'volume_name': 'volume-1440949d-15e9-4329-83b0-668c7e299413', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1a99ed-3195-48b0-aaf0-60ac964f532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1a99ed-3195-48b0-aaf0-60ac964f532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35495060-ec65-46db-b652-99c9f4255a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:45 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Volume 1440949d-15e9-4329-83b0-668c7e299413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1440949d-15e9-4329-83b0-668c7e299413', 'volume_size': 1}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-589486370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1440949d-15e9-4329-83b0-668c7e299413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a9830cd41845b990dcee93880823e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:45Z,use_quota=True,user_id='2a6aa585324b4bdcb0718319123e89b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Creating volume 1440949d-15e9-4329-83b0-668c7e299413 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:02:45 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:02:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:45 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 1073741824
Sep 12 21:02:45 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:46 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 1073741824" returned: 0 in 0.647s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:46 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413
Sep 12 21:02:46 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:46 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413" returned: 0 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35495060-ec65-46db-b652-99c9f4255a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1440949d-15e9-4329-83b0-668c7e299413', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7127b37-f873-4d0a-bfe6-00ee2580a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:46 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Volume volume-1440949d-15e9-4329-83b0-668c7e299413 (1440949d-15e9-4329-83b0-668c7e299413): created successfully
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7127b37-f873-4d0a-bfe6-00ee2580a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Flow 'volume_create_manager' (8217862f-a3ab-47ef-82b8-030c471610d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bba8ebf7-72c6-4f7c-809c-3fbe36b94ed0 tempest-AttachVolumeNegativeTest-234808514 None] Created volume successfully.
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Flow 'volume_create_manager' (69fba8e2-114b-4660-b7c9-0e7a9e7d7ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9e43b2-b133-46a9-a0af-23f587fb57d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9e43b2-b133-46a9-a0af-23f587fb57d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1597308770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e1c8cf-8414-429a-b0f1-729f2f62839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535c61d961c44fe3a6511abc2962939b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:48Z,use_quota=True,user_id='e0126ddc083c4051b7870cf19bba94e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e51032-fdb7-4bed-be79-f443a55c5bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e51032-fdb7-4bed-be79-f443a55c5bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ceaa69-36e9-4d04-be32-b4a5f69fb81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:47 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ceaa69-36e9-4d04-be32-b4a5f69fb81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7e1c8cf-8414-429a-b0f1-729f2f62839f', 'volume_name': 'volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056f2b980>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d001089a-2cc5-4d89-8582-6b27bad5cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d001089a-2cc5-4d89-8582-6b27bad5cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4a998c-0865-4658-bf75-f1e635037f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:48 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Volume c7e1c8cf-8414-429a-b0f1-729f2f62839f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056f2b980>}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Trying to clone c7e1c8cf-8414-429a-b0f1-729f2f62839f from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:02:48 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Image download 20.69 MB at 20.69 MB/s
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d55ce6-4bae-41b7-a560-de8a23578acd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0581aa-48cb-4f47-8f18-4276a0a280ec]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:49 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413
Sep 12 21:02:49 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:49 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD
Sep 12 21:02:49 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:49 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 is fetched for user e0126ddc083c4051b7870cf19bba94e4. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:02:49 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d9280-3beb-415e-87f7-2260c3065212]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413" returned: 0 in 0.739s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.759s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-1440949d-15e9-4329-83b0-668c7e299413', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8173b4d-2da9-40fb-a875-c5fd0cf9365c', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:02:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-f29c2e5c-9f31-4d36-a5be-5c45a2d56572 req-deb04475-5671-4b07-ac2a-ddede36f1946 tempest-AttachVolumeNegativeTest-234808514 None] attachment_update completed successfully.
Sep 12 21:02:49 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD
Sep 12 21:02:49 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:50 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1597308770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e1c8cf-8414-429a-b0f1-729f2f62839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535c61d961c44fe3a6511abc2962939b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:02:48Z,use_quota=True,user_id='e0126ddc083c4051b7870cf19bba94e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Creating volume c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:02:50 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:02:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:50 devstack sudo[98358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 1073741824
Sep 12 21:02:50 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:51 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 1073741824" returned: 0 in 0.897s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:51 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:02:51 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:51 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 0 in 0.409s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Attempting download of 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume c7e1c8cf-8414-429a-b0f1-729f2f62839f. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[55891cb5-ab40-4ff6-a049-f6d3ec7795ff]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:52 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful
Sep 12 21:02:52 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:52 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful" returned: 0 in 0.478s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:52 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful
Sep 12 21:02:52 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:52 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful" returned: 1 in 0.446s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_cba63ful' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:02:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c789db09-3c2f-429e-889c-c82ad6cf91ca]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:53 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD
Sep 12 21:02:53 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:53 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:53 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 was qcow2, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:02:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:53 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:02:53 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-9f5c3a70-9efe-414c-8858-7cb4e202d28e req-8d939ae2-7a26-48ef-bcf2-e6b6f75a6db3 tempest-AttachVolumeNegativeTest-234808514 None] Terminate volume connection completed successfully.
Sep 12 21:02:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-9f5c3a70-9efe-414c-8858-7cb4e202d28e req-8d939ae2-7a26-48ef-bcf2-e6b6f75a6db3 tempest-AttachVolumeNegativeTest-234808514 None] Deleting attachment a8173b4d-2da9-40fb-a875-c5fd0cf9365c. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:02:56 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 0 in 2.884s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:56 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_fbork77gdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:02:56 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Converted 112.00 MB image at 38.81 MB/s
Sep 12 21:02:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:56 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 1G
Sep 12 21:02:56 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:56 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 1G" returned: 0 in 0.602s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb5516b-2438-4a25-ae13-09238a4c0e3f]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:57 devstack sudo[98754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:02:57 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:57 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 0 in 0.752s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:58 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:02:58 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:02:58 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 1 in 0.795s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Downloaded image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume c7e1c8cf-8414-429a-b0f1-729f2f62839f successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 for user e0126ddc083c4051b7870cf19bba94e4 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Marking volume c7e1c8cf-8414-429a-b0f1-729f2f62839f as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Copying metadata from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 to c7e1c8cf-8414-429a-b0f1-729f2f62839f. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Creating volume glance metadata for volume c7e1c8cf-8414-429a-b0f1-729f2f62839f backed by image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4a998c-0865-4658-bf75-f1e635037f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056f2b980>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f33a8f9-8f1c-4264-bdcb-41e6ac09e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:02:58 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Volume volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f (c7e1c8cf-8414-429a-b0f1-729f2f62839f): created successfully
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f33a8f9-8f1c-4264-bdcb-41e6ac09e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:02:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Flow 'volume_create_manager' (69fba8e2-114b-4660-b7c9-0e7a9e7d7ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:02:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-aba67559-86a5-460f-83cd-9655f6263ac2 tempest-VolumesExtendTest-238606727 None] Created volume successfully.
Sep 12 21:02:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:02:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:02:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[319235b6-69c4-4e2e-a856-a29437deeb38]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:02:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:02:59 devstack sudo[98802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:02:59 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:00 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 0 in 0.595s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Flow 'volume_create_manager' (60171ce0-8f2b-4714-a265-eb4a1f3f35df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a750b2-ae1e-4f04-b7af-aba10602399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a750b2-ae1e-4f04-b7af-aba10602399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2072035131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3e36f2-5bd4-4a47-a78b-ec161e02da5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73760ad9d4549ca86bbe747df7b1a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:00Z,use_quota=True,user_id='16f4b4bc4a93425cafc00432734481fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a701abe-e2f0-47ba-9a05-f04dc65ed139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a701abe-e2f0-47ba-9a05-f04dc65ed139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:00 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cf64f3-9952-41e7-8fe7-7b8b962b673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:00 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cf64f3-9952-41e7-8fe7-7b8b962b673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b3e36f2-5bd4-4a47-a78b-ec161e02da5a', 'volume_name': 'volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056c591f0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faf3469-a42b-45ad-b55b-72593254b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faf3469-a42b-45ad-b55b-72593254b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287247b0-fe88-4d59-aa07-fefd1e15ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:00 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Volume 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056c591f0>}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Trying to clone 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:03:00 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 1 in 0.499s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 2G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f 2G" returned: 0 in 0.110s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.274s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1f748bc8-370d-43b2-998a-4ac1d384856b tempest-VolumesExtendTest-238606727 None] Extend volume completed successfully.
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:03:01 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Image download 20.69 MB at 20.69 MB/s
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a23b3-548c-477d-8c1f-ebc16c24b921]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:01 devstack sudo[98815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD
Sep 12 21:03:01 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:01 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 is fetched for user 16f4b4bc4a93425cafc00432734481fd. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bb5683-cd0f-45be-8c4a-7ef728a1cef7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:01 devstack sudo[98822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD
Sep 12 21:03:01 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:02 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2072035131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3e36f2-5bd4-4a47-a78b-ec161e02da5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73760ad9d4549ca86bbe747df7b1a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:00Z,use_quota=True,user_id='16f4b4bc4a93425cafc00432734481fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Creating volume 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:02 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-c7e1c8cf-8414-429a-b0f1-729f2f62839f-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:02 devstack sudo[98828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a 1073741824
Sep 12 21:03:02 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Lock "cinder-c7e1c8cf-8414-429a-b0f1-729f2f62839f-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-quobyte-c7e1c8cf-8414-429a-b0f1-729f2f62839f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-c7e1c8cf-8414-429a-b0f1-729f2f62839f" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb0f3b-7502-47f0-bbb0-556a3b9105f8]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:02 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:03:02 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:02 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a 1073741824" returned: 0 in 0.511s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:02 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:02 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:02 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 0 in 0.462s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:03 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Attempting download of 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:03:03 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:03:03 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c3c861-a21a-4f61-bdbd-27c7158e9fe0]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:03 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e
Sep 12 21:03:03 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:03 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 1 in 0.467s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:03 devstack sudo[98848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f
Sep 12 21:03:03 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:03 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e" returned: 0 in 0.433s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:03 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c7e1c8cf-8414-429a-b0f1-729f2f62839f" returned: 0 in 0.279s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:03 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e
Sep 12 21:03:03 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-c7e1c8cf-8414-429a-b0f1-729f2f62839f" released by "delete_volume" :: held 1.323s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Created reservations ['09be5456-3a1b-4337-8d70-5e5ee29dabfa', '6b802e19-eee6-4cbe-83db-ab6ff49db20f', '3930d0a8-4e40-46ec-b001-996074e14f89', '62766765-6d54-42c5-ad46-b1a8ba91b6cb'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:03 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:03 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:03 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e" returned: 1 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_qerbf_7e' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bb61b8-c3e2-4fc6-bbb5-cca8261244f2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:04 devstack sudo[98859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD
Sep 12 21:03:04 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:04 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.351s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:04 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Deleted volume successfully.
Sep 12 21:03:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5115ea3a-b825-4a7c-a21e-735705483872 tempest-VolumesExtendTest-238606727 None] Lock "cinder-c7e1c8cf-8414-429a-b0f1-729f2f62839f-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:04 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:04 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 was qcow2, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:03:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:04 devstack sudo[98891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:04 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Flow 'volume_create_manager' (2333d17e-8b3d-4888-9e2f-412658ba2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e4852d-bb45-4b42-b0dd-c9acf7d49730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e4852d-bb45-4b42-b0dd-c9acf7d49730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1248762543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b97d9c1-3db5-47ed-894d-e3df45b1c241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535c61d961c44fe3a6511abc2962939b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:05Z,use_quota=True,user_id='e0126ddc083c4051b7870cf19bba94e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d610502-23e6-4202-ac25-cedb77f2cb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d610502-23e6-4202-ac25-cedb77f2cb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86852c3d-acde-4ce8-925f-4986bdc3d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86852c3d-acde-4ce8-925f-4986bdc3d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b97d9c1-3db5-47ed-894d-e3df45b1c241', 'volume_name': 'volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3865ac8b-93fc-4ca8-9fc1-18cde6c36b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3865ac8b-93fc-4ca8-9fc1-18cde6c36b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a63d028-4ea6-4c78-ab5d-3d18f7d20e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:05 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Volume 4b97d9c1-3db5-47ed-894d-e3df45b1c241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241', 'volume_size': 1}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1248762543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b97d9c1-3db5-47ed-894d-e3df45b1c241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535c61d961c44fe3a6511abc2962939b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:05Z,use_quota=True,user_id='e0126ddc083c4051b7870cf19bba94e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Creating volume 4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:05 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:05 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 1073741824
Sep 12 21:03:05 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:05 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 1073741824" returned: 0 in 0.664s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:05 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241
Sep 12 21:03:05 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:06 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241" returned: 0 in 0.284s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a63d028-4ea6-4c78-ab5d-3d18f7d20e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8878c71-5539-40af-8630-8400d7d4aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:06 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Volume volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 (4b97d9c1-3db5-47ed-894d-e3df45b1c241): created successfully
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8878c71-5539-40af-8630-8400d7d4aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Flow 'volume_create_manager' (2333d17e-8b3d-4888-9e2f-412658ba2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-91963c36-2741-4b8b-b6c2-e929833f00df tempest-VolumesExtendTest-238606727 None] Created volume successfully.
Sep 12 21:03:06 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 0 in 1.928s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_olj__re6devstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:03:06 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Converted 112.00 MB image at 58.05 MB/s
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:06 devstack sudo[98919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a 1G
Sep 12 21:03:06 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:06 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a 1G" returned: 0 in 0.370s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eced689-1230-48fe-a169-e1f904d0f1b4]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:06 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:06 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:07 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 0 in 0.388s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:07 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:07 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Creating offline snapshot 3017090f-1b97-47e6-935c-76d1e89cd298 of volume 4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99b2e7f-6310-4efb-83d3-0f98e2f27913]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:07 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241
Sep 12 21:03:07 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:07 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 1 in 0.448s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Downloaded image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 for user 16f4b4bc4a93425cafc00432734481fd is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Marking volume 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Copying metadata from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 to 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Creating volume glance metadata for volume 3b3e36f2-5bd4-4a47-a78b-ec161e02da5a backed by image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287247b0-fe88-4d59-aa07-fefd1e15ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056c591f0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bec97d-4cfc-4593-a955-6c22d1742a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Volume volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a (3b3e36f2-5bd4-4a47-a78b-ec161e02da5a): created successfully
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bec97d-4cfc-4593-a955-6c22d1742a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Flow 'volume_create_manager' (60171ce0-8f2b-4714-a265-eb4a1f3f35df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:07 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3a26ee8b-c889-4e5e-be87-081a4c91a80c tempest-VolumesImageMetadata-1891057740 None] Created volume successfully.
Sep 12 21:03:07 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241" returned: 0 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:07 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 1G
Sep 12 21:03:07 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:08 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 1G" returned: 0 in 0.453s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:08 devstack sudo[98950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298
Sep 12 21:03:08 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:09 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298" returned: 0 in 0.629s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:09 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 is being set with open permissions: ugo+rw
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:09 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298
Sep 12 21:03:09 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:09 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Acquiring lock "cinder-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298" returned: 0 in 0.531s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Lock "cinder-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:09 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info
Sep 12 21:03:09 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Acquiring lock "cinder-quobyte-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Lock "cinder-quobyte-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba93a7-3f25-4d54-a280-4039fa4234e0]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:09 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info" returned: 0 in 0.324s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:09 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info is being set with open permissions: ugo+rw
Sep 12 21:03:09 devstack sudo[99025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:09 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:10 devstack sudo[99029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info
Sep 12 21:03:10 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:10 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 0 in 0.468s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:10 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.info" returned: 0 in 0.317s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.848s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8faa793b-669b-49bc-936a-63edaa8c3e2f tempest-VolumesExtendTest-238606727 None] Create snapshot completed successfully
Sep 12 21:03:10 devstack sudo[99036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:10 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:10 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 1 in 0.441s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:10 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a
Sep 12 21:03:10 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570dcf4-7fc6-45e0-9b49-bb13d4b916d6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:11 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241
Sep 12 21:03:11 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:11 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Lock "cinder-quobyte-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a" released by "delete_volume" :: held 1.399s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Created reservations ['19c94973-386c-4410-8173-f7ce745736fe', '825ec3dc-6b9e-42fa-b861-280f0c032773', '9e0f00e2-1886-4161-af15-f453d5b3600a', 'ae212338-21db-4dda-a4ce-4b25a347e0b3'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:11 devstack sudo[99046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:11 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:11 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241" returned: 0 in 0.504s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 2G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 2G" returned: 0 in 0.173s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.740s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:11 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.393s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Deleted volume successfully.
Sep 12 21:03:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8af9a39d-c129-43e4-a300-bd5a8aa9af3f tempest-VolumesExtendTest-238606727 None] Extend volume completed successfully.
Sep 12 21:03:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3b24b8a2-10f3-457f-b99e-461482bdac45 tempest-VolumesImageMetadata-1891057740 None] Lock "cinder-3b3e36f2-5bd4-4a47-a78b-ec161e02da5a-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-3017090f-1b97-47e6-935c-76d1e89cd298-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Lock "cinder-3017090f-1b97-47e6-935c-76d1e89cd298-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-quobyte-4b97d9c1-3db5-47ed-894d-e3df45b1c241" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-4b97d9c1-3db5-47ed-894d-e3df45b1c241" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-quobyte-3017090f-1b97-47e6-935c-76d1e89cd298" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-3017090f-1b97-47e6-935c-76d1e89cd298" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Deleting offline snapshot 3017090f-1b97-47e6-935c-76d1e89cd298 of volume 4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] snapshot_file for this snap is: volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da90227-0dec-4b05-8292-361ce377301c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:12 devstack sudo[99058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298
Sep 12 21:03:12 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:13 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298" returned: 0 in 0.555s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd81b5a-4e7f-4cd2-bf62-8012d51f8d4d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:13 devstack sudo[99064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241
Sep 12 21:03:13 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:13 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241" returned: 0 in 0.618s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:13 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298
Sep 12 21:03:13 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:14 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298" returned: 0 in 0.487s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:14 devstack sudo[99075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298
Sep 12 21:03:14 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:14 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241.3017090f-1b97-47e6-935c-76d1e89cd298" returned: 0 in 0.295s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-3017090f-1b97-47e6-935c-76d1e89cd298" released by "_delete_snapshot" :: held 2.216s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-4b97d9c1-3db5-47ed-894d-e3df45b1c241" released by "delete_snapshot" :: held 2.273s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Created reservations ['9cea538e-6b3c-4d73-b515-ed3084ad0111', '3b38a573-f82c-45f0-9732-66cb331de278', '5b93255a-8940-40a2-ad2b-9ac3130ed4d3', 'eb7f252e-ff8c-4e02-a454-d839871016e9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Delete snapshot completed successfully.
Sep 12 21:03:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5e0502b4-e2d7-4fc2-83f2-94edcb2af59e tempest-VolumesExtendTest-238606727 None] Lock "cinder-3017090f-1b97-47e6-935c-76d1e89cd298-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-4b97d9c1-3db5-47ed-894d-e3df45b1c241-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Lock "cinder-4b97d9c1-3db5-47ed-894d-e3df45b1c241-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Acquiring lock "cinder-quobyte-4b97d9c1-3db5-47ed-894d-e3df45b1c241" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-4b97d9c1-3db5-47ed-894d-e3df45b1c241" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a03bf91-6e69-4429-961f-c00788c927cd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:15 devstack sudo[99079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241
Sep 12 21:03:15 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:16 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:16 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241
Sep 12 21:03:16 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:16 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b97d9c1-3db5-47ed-894d-e3df45b1c241" returned: 0 in 0.322s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Lock "cinder-quobyte-4b97d9c1-3db5-47ed-894d-e3df45b1c241" released by "delete_volume" :: held 0.796s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Created reservations ['7a116217-410f-4edd-a93d-3230366a3644', '30f6afd5-13cb-4f92-b713-38a3f6520a87', 'c0c43bc5-d038-418f-acde-b03f41ea2735', 'e3a716ef-41a2-4ad8-b6f4-7d7637486d2d'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:16 devstack sudo[99089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:16 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Flow 'volume_create_manager' (89f7e700-708e-4b4d-abb0-ab2dbff1b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6b9afc-47a1-4f74-9656-b983191cd038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6b9afc-47a1-4f74-9656-b983191cd038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-539093727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1067e96326ee4c3c8046ed1edc9be7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:17Z,use_quota=True,user_id='a11174bb9ed046258568d10d60b73f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b640d6df-e5aa-4fbd-9822-586079c810b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b640d6df-e5aa-4fbd-9822-586079c810b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef47863a-6249-48ae-b407-0f8918e37527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef47863a-6249-48ae-b407-0f8918e37527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d', 'volume_name': 'volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf750cca-c7dd-4472-9f0b-c7a8627dc731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf750cca-c7dd-4472-9f0b-c7a8627dc731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70a5d50-eb7a-4de3-a674-1684d9515852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Volume 7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d', 'volume_size': 1}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-539093727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1067e96326ee4c3c8046ed1edc9be7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:17Z,use_quota=True,user_id='a11174bb9ed046258568d10d60b73f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Creating volume 7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:17 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:17 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:17 devstack sudo[99092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d 1073741824
Sep 12 21:03:17 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Deleted volume successfully.
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a17bb5c6-9bce-43d1-94a3-266fc502c0fd tempest-VolumesExtendTest-238606727 None] Lock "cinder-4b97d9c1-3db5-47ed-894d-e3df45b1c241-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:17 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d 1073741824" returned: 0 in 0.709s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:17 devstack sudo[99101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:17 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:18 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.365s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.033s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70a5d50-eb7a-4de3-a674-1684d9515852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a12035-c6c5-46d2-a7af-8027bbbfec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eb3232-ac40-4929-9a93-29745191cdaa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:18 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Volume volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d (7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d): created successfully
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a12035-c6c5-46d2-a7af-8027bbbfec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Flow 'volume_create_manager' (89f7e700-708e-4b4d-abb0-ab2dbff1b462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-47c05067-ac86-4ea0-9476-84781ceec0b9 tempest-VolumesDeleteCascade-1016224806 None] Created volume successfully.
Sep 12 21:03:18 devstack sudo[99112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55
Sep 12 21:03:18 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:18 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55" returned: 0 in 0.514s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.546s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-47e5219f-0929-4024-95a5-185a6490bf55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d49e18e-8e4b-408c-b4de-413f4ac526b3', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:03:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-c2c54f76-983b-4e33-872f-2d768bfac028 req-eb24e2d6-d1cf-4b06-a48b-0c7c39c94b0d tempest-TestServerVolumeAttachmentScenario-637700333 None] attachment_update completed successfully.
Sep 12 21:03:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Creating offline snapshot 60d9eb1e-c320-4401-9594-c4a1f0316fa1 of volume 7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:03:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e753b04-0169-40fd-adea-a76e30c5a87a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:19 devstack sudo[99205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:19 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:20 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.548s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:20 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 1G
Sep 12 21:03:20 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:20 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 1G" returned: 0 in 0.520s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:20 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:20 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:20 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.403s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:20 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 is being set with open permissions: ugo+rw
Sep 12 21:03:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:20 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:20 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:21 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.329s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:21 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=107,cinder:SELECT=104,cinder:INSERT=33,cinder:DELETE=6 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:03:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:21 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info
Sep 12 21:03:21 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:21 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info" returned: 0 in 0.308s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:21 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info is being set with open permissions: ugo+rw
Sep 12 21:03:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:21 devstack sudo[99530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info
Sep 12 21:03:21 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:22 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.info" returned: 0 in 0.396s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-fd4b6fc1-e374-45a3-8ed6-c46489e0b7d9 tempest-VolumesDeleteCascade-1016224806 None] Create snapshot completed successfully
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Flow 'volume_create_manager' (47f8bd0d-c31a-4112-b5c6-7e2572283399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5cbed5-040d-44cc-b437-001bdee01da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5cbed5-040d-44cc-b437-001bdee01da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-980838979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a2a684-df48-4bdb-b4ca-4d3964a05364,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55c95105b6154d0487bc329d25aade64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:22Z,use_quota=True,user_id='c776c81aba9444c7889b072837561dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27c164c-7395-4058-b194-f4143ad11423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27c164c-7395-4058-b194-f4143ad11423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2f8233-98a2-4a9e-9a90-bbd63d988d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2f8233-98a2-4a9e-9a90-bbd63d988d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a2a684-df48-4bdb-b4ca-4d3964a05364', 'volume_name': 'volume-55a2a684-df48-4bdb-b4ca-4d3964a05364', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d7fc8b-ac76-46ea-9026-4fecaf04ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d7fc8b-ac76-46ea-9026-4fecaf04ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d00bba5-1799-45ca-8678-be86a4f186a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Volume 55a2a684-df48-4bdb-b4ca-4d3964a05364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a2a684-df48-4bdb-b4ca-4d3964a05364', 'volume_size': 1}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-980838979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a2a684-df48-4bdb-b4ca-4d3964a05364,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55c95105b6154d0487bc329d25aade64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:22Z,use_quota=True,user_id='c776c81aba9444c7889b072837561dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Creating volume 55a2a684-df48-4bdb-b4ca-4d3964a05364 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:22 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:22 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 1073741824
Sep 12 21:03:22 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:22 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 1073741824" returned: 0 in 0.530s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:22 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364
Sep 12 21:03:22 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:23 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d00bba5-1799-45ca-8678-be86a4f186a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a2a684-df48-4bdb-b4ca-4d3964a05364', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e8dae8-0ff4-479c-94b0-a7ab4415e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:23 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Volume volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 (55a2a684-df48-4bdb-b4ca-4d3964a05364): created successfully
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e8dae8-0ff4-479c-94b0-a7ab4415e725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Flow 'volume_create_manager' (47f8bd0d-c31a-4112-b5c6-7e2572283399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:23 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b4eb7e89-72de-4cc6-b21b-2cbef2cfa6d9 tempest-VolumesListTestJSON-1199038926 None] Created volume successfully.
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Creating offline snapshot e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 of volume 7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d371d-1394-4f8f-a778-21130324cc13]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:23 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:23 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:23 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:23 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 1G
Sep 12 21:03:23 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:24 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 1G" returned: 0 in 0.416s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:24 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80
Sep 12 21:03:24 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:24 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" returned: 0 in 0.308s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:24 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 is being set with open permissions: ugo+rw
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:24 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80
Sep 12 21:03:24 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Flow 'volume_create_manager' (a8e62bfc-03d7-4456-a391-528052ab1ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95ef7fc-c4f6-4289-a23f-36aa60de3c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:24 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" returned: 0 in 0.298s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95ef7fc-c4f6-4289-a23f-36aa60de3c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-716777666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529d26ca-2354-4c36-bf3d-481a23e66b3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55c95105b6154d0487bc329d25aade64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:25Z,use_quota=True,user_id='c776c81aba9444c7889b072837561dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd9b6ed-6e72-48f1-ba7a-3b6e11a0ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd9b6ed-6e72-48f1-ba7a-3b6e11a0ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee28559-50b9-441c-8da0-50e3e9e9cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee28559-50b9-441c-8da0-50e3e9e9cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529d26ca-2354-4c36-bf3d-481a23e66b3f', 'volume_name': 'volume-529d26ca-2354-4c36-bf3d-481a23e66b3f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeed294-8c69-461a-90bc-3eed4564497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeed294-8c69-461a-90bc-3eed4564497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d89632-e23e-496b-875a-514f12930005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:24 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Volume 529d26ca-2354-4c36-bf3d-481a23e66b3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529d26ca-2354-4c36-bf3d-481a23e66b3f', 'volume_size': 1}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.560s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.060s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[998507e3-a270-41c7-9e64-ad9051526d70]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-20fc76e9-967c-4d14-8b53-2b9b5b074d01 tempest-VolumesDeleteCascade-1016224806 None] Create snapshot completed successfully
Sep 12 21:03:25 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b
Sep 12 21:03:25 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:25 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.375s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-716777666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529d26ca-2354-4c36-bf3d-481a23e66b3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55c95105b6154d0487bc329d25aade64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:25Z,use_quota=True,user_id='c776c81aba9444c7889b072837561dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Creating volume 529d26ca-2354-4c36-bf3d-481a23e66b3f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:25 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:25 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f 1073741824
Sep 12 21:03:25 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e737c29-3461-4223-93e7-a7692e26fe42', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:03:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-50d5bc84-6496-4e32-87f6-45bbf8420d4a req-e6b34019-83c5-41e7-97c5-3d2ca105b483 tempest-TestServerVolumeAttachmentScenario-637700333 None] attachment_update completed successfully.
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:25 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f 1073741824" returned: 0 in 0.561s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Performing cascade delete. {{(pid=87624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-60d9eb1e-c320-4401-9594-c4a1f0316fa1-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-60d9eb1e-c320-4401-9594-c4a1f0316fa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:25 devstack sudo[99605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f
Sep 12 21:03:25 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-60d9eb1e-c320-4401-9594-c4a1f0316fa1" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-60d9eb1e-c320-4401-9594-c4a1f0316fa1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Deleting offline snapshot 60d9eb1e-c320-4401-9594-c4a1f0316fa1 of volume 7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:03:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] snapshot_file for this snap is: volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[efee962f-5c5c-44e0-9ecc-0fbb58b80f44]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:26 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:26 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:26 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d89632-e23e-496b-875a-514f12930005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529d26ca-2354-4c36-bf3d-481a23e66b3f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a095cc8a-f26c-4f61-839b-815a7e908e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:26 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Volume volume-529d26ca-2354-4c36-bf3d-481a23e66b3f (529d26ca-2354-4c36-bf3d-481a23e66b3f): created successfully
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a095cc8a-f26c-4f61-839b-815a7e908e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Flow 'volume_create_manager' (a8e62bfc-03d7-4456-a391-528052ab1ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f1f8fcd6-b2d8-48e4-90cc-e6bdebfea9c6 tempest-VolumesListTestJSON-1199038926 None] Created volume successfully.
Sep 12 21:03:26 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.362s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[58551dca-a52a-476f-b8a0-c6e600b95252]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:26 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:26 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:26 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61ba78a-420c-45fc-9372-e9dd6d6d2402]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:26 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80
Sep 12 21:03:26 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:27 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" returned: 0 in 0.369s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44d3f38-aa66-47de-b896-0e563ecb8f6e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:27 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:27 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Flow 'volume_create_manager' (2e806c31-4d80-4ba5-a22a-41d41379b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1d1acb-065c-4e2c-8238-e87ffb2fb48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1d1acb-065c-4e2c-8238-e87ffb2fb48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1715606591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926db8b9-3201-4b03-8687-70abbbaf33bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55c95105b6154d0487bc329d25aade64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:27Z,use_quota=True,user_id='c776c81aba9444c7889b072837561dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c1cfe8-cfa4-4171-9c54-87838345be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c1cfe8-cfa4-4171-9c54-87838345be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e38bb30-f69f-4782-99fc-db3623093ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e38bb30-f69f-4782-99fc-db3623093ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926db8b9-3201-4b03-8687-70abbbaf33bd', 'volume_name': 'volume-926db8b9-3201-4b03-8687-70abbbaf33bd', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:27 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab37e58-9968-49aa-a118-79283778090f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab37e58-9968-49aa-a118-79283778090f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6be178-b691-4323-8c3a-f5726946216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:27 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Volume 926db8b9-3201-4b03-8687-70abbbaf33bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926db8b9-3201-4b03-8687-70abbbaf33bd', 'volume_size': 1}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1715606591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926db8b9-3201-4b03-8687-70abbbaf33bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55c95105b6154d0487bc329d25aade64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:27Z,use_quota=True,user_id='c776c81aba9444c7889b072837561dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Creating volume 926db8b9-3201-4b03-8687-70abbbaf33bd {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:27 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.458s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:27 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd 1073741824
Sep 12 21:03:27 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b822350-60fd-47f8-bc4f-b577f936b2c0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-cfa6331a-e20c-4902-9e6b-07cfb52fc607 req-6c5b3307-9640-4a12-b66b-61850c83a553 tempest-TestServerVolumeAttachmentScenario-637700333 None] Terminate volume connection completed successfully.
Sep 12 21:03:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-cfa6331a-e20c-4902-9e6b-07cfb52fc607 req-6c5b3307-9640-4a12-b66b-61850c83a553 tempest-TestServerVolumeAttachmentScenario-637700333 None] Deleting attachment 1e737c29-3461-4223-93e7-a7692e26fe42. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:03:27 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:27 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:28 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.406s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:28 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:28 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:28 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd 1073741824" returned: 0 in 0.488s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:28 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd
Sep 12 21:03:28 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:28 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd" returned: 0 in 0.266s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:28 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.358s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6be178-b691-4323-8c3a-f5726946216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926db8b9-3201-4b03-8687-70abbbaf33bd', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:28 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ef9eb5-c675-4540-b2a9-754e0d56bb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:28 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:28 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Volume volume-926db8b9-3201-4b03-8687-70abbbaf33bd (926db8b9-3201-4b03-8687-70abbbaf33bd): created successfully
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ef9eb5-c675-4540-b2a9-754e0d56bb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Flow 'volume_create_manager' (2e806c31-4d80-4ba5-a22a-41d41379b341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:28 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9e2682ec-a8eb-4df7-b9b3-a7016ecffce9 tempest-VolumesListTestJSON-1199038926 None] Created volume successfully.
Sep 12 21:03:28 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.60d9eb1e-c320-4401-9594-c4a1f0316fa1" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 -F qcow2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:28 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 -F qcow2
Sep 12 21:03:28 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:29 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 -F qcow2" returned: 0 in 0.306s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-60d9eb1e-c320-4401-9594-c4a1f0316fa1" released by "_delete_snapshot" :: held 3.076s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" released by "delete_snapshot" :: held 3.102s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Created reservations ['971e231c-c307-4763-82d2-035e5e3d5943', 'b45b3b9b-2260-4d52-815b-47cf7cb943db', 'e1af826e-e741-4606-9d27-9cbf1e5f0360', '0c82ab02-4aad-4038-b2c4-4099f90e8e51'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-31578770-5a39-4fd8-98b0-41c4bd23c408 req-5ba49d52-d6ee-4116-80d4-fcdaf633b97d tempest-TestServerVolumeAttachmentScenario-637700333 None] Terminate volume connection completed successfully.
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-31578770-5a39-4fd8-98b0-41c4bd23c408 req-5ba49d52-d6ee-4116-80d4-fcdaf633b97d tempest-TestServerVolumeAttachmentScenario-637700333 None] Deleting attachment 6d49e18e-8e4b-408c-b4de-413f4ac526b3. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:03:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Delete snapshot completed successfully.
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-60d9eb1e-c320-4401-9594-c4a1f0316fa1-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Deleting offline snapshot e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 of volume 7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] snapshot_file for this snap is: volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b936cfb-b6bd-42ee-9339-d334be6ceb69]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:29 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80
Sep 12 21:03:29 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:29 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" returned: 0 in 0.450s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df721c-1d96-4aa9-bf4a-2375eb8b6fe3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:29 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:29 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:30 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.507s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:30 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80
Sep 12 21:03:30 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:31 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" returned: 0 in 0.679s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:31 devstack sudo[99722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80
Sep 12 21:03:31 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:31 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d.e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" returned: 0 in 0.433s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80" released by "_delete_snapshot" :: held 2.245s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" released by "delete_snapshot" :: held 2.277s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Created reservations ['9553d259-919c-44ac-baeb-d73171586825', 'a3e35853-6cf4-4332-a5f5-47a3bf0f12d2', '34d070c4-af76-478b-858b-1c0869ee6030', 'b85d49a9-4cbf-4514-8028-fcda931a0883'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Delete snapshot completed successfully.
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-e32d6ed9-5e99-4706-b2eb-8c43fc9e3d80-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Snapshots deleted, issuing volume delete {{(pid=87624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055388e-28df-442d-a933-7729b2d4ec7d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:31 devstack sudo[99727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:31 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:32 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.486s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:32 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d
Sep 12 21:03:32 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:32 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" returned: 0 in 0.324s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d" released by "delete_volume" :: held 0.891s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Created reservations ['137194b8-ecda-40b6-a9a6-e08dc26850aa', '083eced9-930e-4102-83b2-9fa38bbb81d7', '331e6d23-b6c9-48c8-bca3-cd7e875a1495', 'ae667cbc-730d-41b9-8e63-959f84aab28e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:32 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:32 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "cinder-926db8b9-3201-4b03-8687-70abbbaf33bd-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-926db8b9-3201-4b03-8687-70abbbaf33bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "cinder-quobyte-926db8b9-3201-4b03-8687-70abbbaf33bd" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:33 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-quobyte-926db8b9-3201-4b03-8687-70abbbaf33bd" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:33 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Deleted volume successfully.
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c24cad-a539-4c9c-a377-3cf3649e3c6a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7af2acce-202b-4182-9c4f-dafbaa8cff95 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-7f7cfe87-cbfd-4c10-bbbe-3c12f19c688d-delete_volume" released by "delete_volume" :: held 7.433s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:33 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd
Sep 12 21:03:33 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:33 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:33 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:33 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.393s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:33 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd" returned: 0 in 0.627s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:33 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd
Sep 12 21:03:33 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:33 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Flow 'volume_create_manager' (de928289-c11e-4c1e-b1bd-e521e3e48e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d1a500-141d-4832-9c23-3c2889be1fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d1a500-141d-4832-9c23-3c2889be1fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-699915192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9adafef-cbb4-4bf8-b546-4d46dc6f0a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a9830cd41845b990dcee93880823e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:34Z,use_quota=True,user_id='2a6aa585324b4bdcb0718319123e89b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e378095a-d374-41d4-9258-673d33e171a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e378095a-d374-41d4-9258-673d33e171a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252a7775-fa98-41d2-a42c-6d0534a5e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252a7775-fa98-41d2-a42c-6d0534a5e8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9adafef-cbb4-4bf8-b546-4d46dc6f0a29', 'volume_name': 'volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db39378-a5d9-441b-a9ff-8f6b6f0855f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db39378-a5d9-441b-a9ff-8f6b6f0855f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fccfa1b-268f-4fda-a778-80b46654983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Volume d9adafef-cbb4-4bf8-b546-4d46dc6f0a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29', 'volume_size': 1}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-699915192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9adafef-cbb4-4bf8-b546-4d46dc6f0a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a9830cd41845b990dcee93880823e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:34Z,use_quota=True,user_id='2a6aa585324b4bdcb0718319123e89b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Creating volume d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:34 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:34 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 1073741824
Sep 12 21:03:34 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:34 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-926db8b9-3201-4b03-8687-70abbbaf33bd" returned: 0 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-quobyte-926db8b9-3201-4b03-8687-70abbbaf33bd" released by "delete_volume" :: held 1.045s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Created reservations ['f65e56af-9b5d-44b9-ae96-5a4c299899b6', '0df3c699-4727-4632-a044-dee47cdd9e04', '60e8a419-a833-4aa3-9813-05cf8ca346da', '8e6b23e3-7479-4fcf-b56a-4c133724f36f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "cinder-26cb20e4-48e0-41c5-bc3c-f35e2da0523b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-26cb20e4-48e0-41c5-bc3c-f35e2da0523b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:34 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:34 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "cinder-quobyte-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-quobyte-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acddf03-3638-44b4-9259-3622f9c7dd9d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:34 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b
Sep 12 21:03:34 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Flow 'volume_create_manager' (09074cd2-9025-411f-bb8f-7dd6f5070577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe4bb2f-6e9f-40d5-bc76-b635409e5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 1073741824" returned: 0 in 0.602s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe4bb2f-6e9f-40d5-bc76-b635409e5700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-391619108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693afeb7-7dd2-42b4-b605-ee6815860df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1067e96326ee4c3c8046ed1edc9be7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:35Z,use_quota=True,user_id='a11174bb9ed046258568d10d60b73f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd72003-a090-4672-87ba-912689ef6d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd72003-a090-4672-87ba-912689ef6d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527f030e-9367-47d8-a704-4f4f30bd7515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527f030e-9367-47d8-a704-4f4f30bd7515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693afeb7-7dd2-42b4-b605-ee6815860df6', 'volume_name': 'volume-693afeb7-7dd2-42b4-b605-ee6815860df6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8744cec2-193d-4d88-8118-0968edf5bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8744cec2-193d-4d88-8118-0968edf5bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a5dc5-b921-4287-9b8e-6d94a8677393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:34 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Volume 693afeb7-7dd2-42b4-b605-ee6815860df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693afeb7-7dd2-42b4-b605-ee6815860df6', 'volume_size': 1}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.321s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Deleted volume successfully.
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1f32133-6877-4cea-b881-32e54625dd3f tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-926db8b9-3201-4b03-8687-70abbbaf33bd-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:34 devstack sudo[99765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29
Sep 12 21:03:34 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:34 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" returned: 0 in 0.418s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:34 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b
Sep 12 21:03:34 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:35 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" returned: 0 in 0.274s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-391619108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693afeb7-7dd2-42b4-b605-ee6815860df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1067e96326ee4c3c8046ed1edc9be7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:35Z,use_quota=True,user_id='a11174bb9ed046258568d10d60b73f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Creating volume 693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:35 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fccfa1b-268f-4fda-a778-80b46654983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e857cad-555b-4909-9d2c-bad2474b5bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:35 devstack sudo[99773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 1073741824
Sep 12 21:03:35 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:35 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Volume volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 (d9adafef-cbb4-4bf8-b546-4d46dc6f0a29): created successfully
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e857cad-555b-4909-9d2c-bad2474b5bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Flow 'volume_create_manager' (de928289-c11e-4c1e-b1bd-e521e3e48e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5eb77161-2833-4e2b-99db-2f718f7e9b94 tempest-AttachVolumeNegativeTest-234808514 None] Created volume successfully.
Sep 12 21:03:35 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" returned: 0 in 0.260s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-quobyte-26cb20e4-48e0-41c5-bc3c-f35e2da0523b" released by "delete_volume" :: held 0.719s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Created reservations ['2bc8e0a1-938b-4b52-b7f8-610e7a99c578', '97384b48-daa9-4b49-ab3e-93d738aa3512', 'd0dbb6a6-67ec-4e49-83e2-5ee9b3b6cf02', '0b1c6f9b-c725-405a-ab89-b30aaa0409f6'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:35 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:35 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "cinder-529d26ca-2354-4c36-bf3d-481a23e66b3f-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-529d26ca-2354-4c36-bf3d-481a23e66b3f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "cinder-quobyte-529d26ca-2354-4c36-bf3d-481a23e66b3f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-quobyte-529d26ca-2354-4c36-bf3d-481a23e66b3f" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d79b65-4876-4cc2-8995-75bc25433c7c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "cinder-47e5219f-0929-4024-95a5-185a6490bf55-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:35 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:35 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-47e5219f-0929-4024-95a5-185a6490bf55-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Deleted volume successfully.
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 1073741824" returned: 0 in 0.568s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:35 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f
Sep 12 21:03:35 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-27dc790b-ef07-4f82-b314-1f6c566979d8 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-26cb20e4-48e0-41c5-bc3c-f35e2da0523b-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "cinder-quobyte-47e5219f-0929-4024-95a5-185a6490bf55" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-quobyte-47e5219f-0929-4024-95a5-185a6490bf55" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c094177-c3a4-48fd-a792-aa420a37e84a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:35 devstack sudo[99786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:35 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:35 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55
Sep 12 21:03:35 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:35 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f" returned: 0 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:36 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f
Sep 12 21:03:36 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:36 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a5dc5-b921-4287-9b8e-6d94a8677393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693afeb7-7dd2-42b4-b605-ee6815860df6', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529fdee2-bfb1-4d66-b5c5-789432bb7d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:36 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Volume volume-693afeb7-7dd2-42b4-b605-ee6815860df6 (693afeb7-7dd2-42b4-b605-ee6815860df6): created successfully
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529fdee2-bfb1-4d66-b5c5-789432bb7d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Flow 'volume_create_manager' (09074cd2-9025-411f-bb8f-7dd6f5070577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0b2cab37-3e74-4680-9678-97347ad2d293 tempest-VolumesDeleteCascade-1016224806 None] Created volume successfully.
Sep 12 21:03:36 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:36 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:36 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55
Sep 12 21:03:36 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-529d26ca-2354-4c36-bf3d-481a23e66b3f" returned: 0 in 0.321s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-quobyte-529d26ca-2354-4c36-bf3d-481a23e66b3f" released by "delete_volume" :: held 0.818s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Created reservations ['a7c23f7b-786f-462e-bf9a-98a6bcf03f68', 'b075ae82-ed24-4a03-9623-616e5e8324bb', '0b3cebc5-2cc5-49f3-8abe-20e92c9400d2', '596b9444-ba00-4dc6-866b-85bca9a8b3a5'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:36 devstack sudo[99806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:36 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:36 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47e5219f-0929-4024-95a5-185a6490bf55" returned: 0 in 0.318s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-quobyte-47e5219f-0929-4024-95a5-185a6490bf55" released by "delete_volume" :: held 0.813s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Created reservations ['0697d7c2-9cc1-442a-a494-367c84bdba53', '6808121d-5c6d-4241-a197-b50655452d67', 'ac07064a-d3c1-48c2-b41f-e6947409cc02', '027e515c-cddf-410d-8637-2c2dbf8646b1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:36 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "cinder-55a2a684-df48-4bdb-b4ca-4d3964a05364-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.331s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Deleted volume successfully.
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-55a2a684-df48-4bdb-b4ca-4d3964a05364-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:36 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:36 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-3af5da83-69ee-4bf1-840e-3eb41cdb62c0 tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-529d26ca-2354-4c36-bf3d-481a23e66b3f-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "cinder-quobyte-55a2a684-df48-4bdb-b4ca-4d3964a05364" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-quobyte-55a2a684-df48-4bdb-b4ca-4d3964a05364" acquired by "delete_volume" :: waited 0.043s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[94129753-fc3f-45c9-80c2-54fb9fb3dd92]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3637628-b249-45c1-a881-4d9090ede179]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:37 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364
Sep 12 21:03:37 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:37 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29
Sep 12 21:03:37 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:37 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.440s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Deleted volume successfully.
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-179b4033-8337-4c9f-ad95-17b5477f48b2 tempest-TestServerVolumeAttachmentScenario-637700333 None] Lock "cinder-47e5219f-0929-4024-95a5-185a6490bf55-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:37 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364" returned: 0 in 0.397s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:37 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:37 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:37 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.434s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.372s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Creating offline snapshot 85a1890c-46ec-417a-baf6-086b880cfbe9 of volume 693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b210527-b9f3-4080-9cea-7fc5a61ad82b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45e3c9fd-9b2d-486d-8c90-b7e4fdbd133f', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-d4dc04a2-f3ac-43b5-99ab-d472ad897e4f req-a84db7b5-b92e-4a64-a025-3d8f1e69bf22 tempest-AttachVolumeNegativeTest-234808514 None] attachment_update completed successfully.
Sep 12 21:03:37 devstack sudo[99833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:37 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:37 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-55a2a684-df48-4bdb-b4ca-4d3964a05364" returned: 0 in 0.345s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-quobyte-55a2a684-df48-4bdb-b4ca-4d3964a05364" released by "delete_volume" :: held 0.831s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Created reservations ['9d226d4e-2a1f-455b-bb6d-ebf4c7b9db47', '618390d6-36bc-4ff7-b445-ae3b3940746a', '612671d6-b353-41fe-b590-fd9afacbb801', '01497e80-5eda-4c45-a1f8-a71c4b5c1d63'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:38 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:38 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:38 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.647s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:38 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 1G
Sep 12 21:03:38 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:38 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Deleted volume successfully.
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e38f9512-751f-4734-84fc-6f1222628a7d tempest-VolumesListTestJSON-1199038926 None] Lock "cinder-55a2a684-df48-4bdb-b4ca-4d3964a05364-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:38 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 1G" returned: 0 in 0.594s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693afeb7-7dd2-42b4-b605-ee6815860df6 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:38 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693afeb7-7dd2-42b4-b605-ee6815860df6 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9
Sep 12 21:03:38 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:39 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693afeb7-7dd2-42b4-b605-ee6815860df6 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:39 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 is being set with open permissions: ugo+rw
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:39 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9
Sep 12 21:03:39 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:39 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9" returned: 0 in 0.337s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:39 devstack sudo[100239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info
Sep 12 21:03:39 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-c194f0bd-a0f1-45df-8a8e-4bd4fc80679c req-8b14fe77-7af5-48b7-b965-863116151692 tempest-AttachVolumeNegativeTest-234808514 None] Terminate volume connection completed successfully.
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-c194f0bd-a0f1-45df-8a8e-4bd4fc80679c req-8b14fe77-7af5-48b7-b965-863116151692 tempest-AttachVolumeNegativeTest-234808514 None] Deleting attachment 45e3c9fd-9b2d-486d-8c90-b7e4fdbd133f. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:03:39 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info" returned: 0 in 0.351s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:39 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info is being set with open permissions: ugo+rw
Sep 12 21:03:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:39 devstack sudo[100268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info
Sep 12 21:03:39 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:40 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.info" returned: 0 in 0.284s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b95f6b33-2b84-45ae-b2ec-37a496f733e5 tempest-VolumesDeleteCascade-1016224806 None] Create snapshot completed successfully
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Flow 'volume_create_manager' (326c5381-a57b-432c-8db0-55c7ff5652ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efba3e53-ea74-4ffe-94b8-44ead11ab84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efba3e53-ea74-4ffe-94b8-44ead11ab84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-322238438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b264971-f58a-404b-a448-1a339d9c05c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1067e96326ee4c3c8046ed1edc9be7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=85a1890c-46ec-417a-baf6-086b880cfbe9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:42Z,use_quota=True,user_id='a11174bb9ed046258568d10d60b73f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2696e0d-1c93-472f-bae2-b649efd6c265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2696e0d-1c93-472f-bae2-b649efd6c265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f0650-cdf0-4fb4-a67f-00b022b95e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f0650-cdf0-4fb4-a67f-00b022b95e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b264971-f58a-404b-a448-1a339d9c05c4', 'volume_name': 'volume-1b264971-f58a-404b-a448-1a339d9c05c4', 'volume_size': 1, 'snapshot_id': '85a1890c-46ec-417a-baf6-086b880cfbe9'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0461e2-115b-4586-abdd-e71fc87e9bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0461e2-115b-4586-abdd-e71fc87e9bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40820948-c704-45a1-acf7-83bba257597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:42 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Volume 1b264971-f58a-404b-a448-1a339d9c05c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b264971-f58a-404b-a448-1a339d9c05c4', 'volume_size': 1, 'snapshot_id': '85a1890c-46ec-417a-baf6-086b880cfbe9'}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-85a1890c-46ec-417a-baf6-086b880cfbe9-1b264971-f58a-404b-a448-1a339d9c05c4" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-85a1890c-46ec-417a-baf6-086b880cfbe9-1b264971-f58a-404b-a448-1a339d9c05c4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Creating volume 1b264971-f58a-404b-a448-1a339d9c05c4 from snapshot 85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-1b264971-f58a-404b-a448-1a339d9c05c4" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-1b264971-f58a-404b-a448-1a339d9c05c4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] snapshot: 85a1890c-46ec-417a-baf6-086b880cfbe9, volume: 1b264971-f58a-404b-a448-1a339d9c05c4,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e634580b-2db8-4c55-ac25-37c3a2ed4d8a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:42 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9
Sep 12 21:03:42 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:42 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9" returned: 0 in 0.492s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693afeb7-7dd2-42b4-b605-ee6815860df6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d55b3-a164-4efb-bb0b-3ea3738a0555]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:43 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:43 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:43 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.522s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:43 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:03:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:43 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4
Sep 12 21:03:43 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Flow 'volume_create_manager' (82887be4-6bd5-4f49-9077-4a02442b17c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fd0393-673f-415f-ab7b-99f7ecdfe47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fd0393-673f-415f-ab7b-99f7ecdfe47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1960594255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a37674b-d18b-4b02-8d71-483af05d77a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9f8df580d640ecb12978c4fc03d0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:45Z,use_quota=True,user_id='b1c4eb4558cd4603b6e74c4d19854dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96f29c2-62b8-4db9-9c7c-ee1f1e4e969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96f29c2-62b8-4db9-9c7c-ee1f1e4e969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedc04e3-7c4f-42fd-b8b2-be3f207966e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedc04e3-7c4f-42fd-b8b2-be3f207966e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a37674b-d18b-4b02-8d71-483af05d77a4', 'volume_name': 'volume-4a37674b-d18b-4b02-8d71-483af05d77a4', 'volume_size': 2}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43114ee7-8e44-4c6c-98ae-c9de300eb37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43114ee7-8e44-4c6c-98ae-c9de300eb37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decbdfaa-fb12-4bbe-90ba-3da8821d366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:45 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Volume 4a37674b-d18b-4b02-8d71-483af05d77a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a37674b-d18b-4b02-8d71-483af05d77a4', 'volume_size': 2}
Sep 12 21:03:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:49 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4" returned: 0 in 5.719s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a84fd0-2606-4181-b611-452db20c2e2f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:49 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:49 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "cinder-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=137,cinder:INSERT=47,cinder:SELECT=134,cinder:DELETE=15 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "cinder-quobyte-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-quobyte-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6789533-d95c-4aa4-85ad-141fbe93fecf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:49 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29
Sep 12 21:03:49 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:49 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.649s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:03:49 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Converted 1024.00 MB image at 179.01 MB/s
Sep 12 21:03:49 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 is being set with open permissions: ugo+rw
Sep 12 21:03:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:49 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4
Sep 12 21:03:49 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:50 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" returned: 0 in 0.362s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:50 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29
Sep 12 21:03:50 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:50 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-1b264971-f58a-404b-a448-1a339d9c05c4" released by "_copy_volume_from_snapshot" :: held 7.802s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-85a1890c-46ec-417a-baf6-086b880cfbe9-1b264971-f58a-404b-a448-1a339d9c05c4" released by "_create_volume_from_snapshot" :: held 7.840s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.861s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.580s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1960594255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a37674b-d18b-4b02-8d71-483af05d77a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9f8df580d640ecb12978c4fc03d0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:03:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:03:45Z,use_quota=True,user_id='b1c4eb4558cd4603b6e74c4d19854dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Creating volume 4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:03:50 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 2147483648 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:50 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 2147483648
Sep 12 21:03:50 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40820948-c704-45a1-acf7-83bba257597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b264971-f58a-404b-a448-1a339d9c05c4', 'volume_size': 1, 'snapshot_id': '85a1890c-46ec-417a-baf6-086b880cfbe9'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d037a680-3061-40ba-af12-4e1cd9885e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:50 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Volume volume-1b264971-f58a-404b-a448-1a339d9c05c4 (1b264971-f58a-404b-a448-1a339d9c05c4): created successfully
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d037a680-3061-40ba-af12-4e1cd9885e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Flow 'volume_create_manager' (326c5381-a57b-432c-8db0-55c7ff5652ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-43cc40ca-efa5-4993-9fc6-8e71183f5b65 tempest-VolumesDeleteCascade-1016224806 None] Created volume successfully.
Sep 12 21:03:50 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" returned: 0 in 0.261s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-quobyte-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29" released by "delete_volume" :: held 0.666s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Created reservations ['e5ffc2c1-c776-41e2-9b40-fd0061e0669e', '17a6a9e6-f511-43dc-ae32-54993a563352', 'b355ae67-337c-404c-8c0d-528f2a590bf0', '766377ba-3612-47de-9b9b-1c7938d76393'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:50 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:50 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:50 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Deleted volume successfully.
Sep 12 21:03:50 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 2147483648" returned: 0 in 0.663s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-013d4ab4-be96-4d50-87d5-647020568ff6 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-d9adafef-cbb4-4bf8-b546-4d46dc6f0a29-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "cinder-1440949d-15e9-4329-83b0-668c7e299413-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:50 devstack sudo[100347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4
Sep 12 21:03:50 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-1440949d-15e9-4329-83b0-668c7e299413-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "cinder-quobyte-1440949d-15e9-4329-83b0-668c7e299413" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-quobyte-1440949d-15e9-4329-83b0-668c7e299413" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3127dd-3aac-4123-953a-8be8c0ded840]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:51 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413
Sep 12 21:03:51 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-693afeb7-7dd2-42b4-b605-ee6815860df6-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:51 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4" returned: 0 in 0.369s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decbdfaa-fb12-4bbe-90ba-3da8821d366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a37674b-d18b-4b02-8d71-483af05d77a4', 'volume_size': 2}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da12c59-c85e-446d-8661-845594f6b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-693afeb7-7dd2-42b4-b605-ee6815860df6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Volume volume-4a37674b-d18b-4b02-8d71-483af05d77a4 (4a37674b-d18b-4b02-8d71-483af05d77a4): created successfully
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da12c59-c85e-446d-8661-845594f6b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Flow 'volume_create_manager' (82887be4-6bd5-4f49-9077-4a02442b17c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:03:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-658f8925-490d-4d5d-aac4-9328dc2d1b84 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Created volume successfully.
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Performing cascade delete. {{(pid=87624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-85a1890c-46ec-417a-baf6-086b880cfbe9-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-85a1890c-46ec-417a-baf6-086b880cfbe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-693afeb7-7dd2-42b4-b605-ee6815860df6" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-693afeb7-7dd2-42b4-b605-ee6815860df6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-85a1890c-46ec-417a-baf6-086b880cfbe9" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-85a1890c-46ec-417a-baf6-086b880cfbe9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Deleting offline snapshot 85a1890c-46ec-417a-baf6-086b880cfbe9 of volume 693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] snapshot_file for this snap is: volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a24dc80-49a8-48f7-b699-d18646b8a721]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:51 devstack sudo[100353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9
Sep 12 21:03:51 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:51 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413" returned: 0 in 0.544s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:51 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413
Sep 12 21:03:51 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:51 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9" returned: 0 in 0.430s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693afeb7-7dd2-42b4-b605-ee6815860df6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:51 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1440949d-15e9-4329-83b0-668c7e299413" returned: 0 in 0.300s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc83982a-7ddf-4866-8428-1b5c970fe885]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-quobyte-1440949d-15e9-4329-83b0-668c7e299413" released by "delete_volume" :: held 0.920s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Created reservations ['a2ca3182-67aa-4379-a9e5-f30964fa4a14', 'b032c75a-e3d7-4e32-aeb2-574beb358039', '5cd76952-fb6c-4c91-af6c-85fe3644d919', '39f455cd-1bd0-4c20-8b35-82605ac53f50'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:52 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:52 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:52 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:52 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Creating offline snapshot 10e59b9b-9367-4590-a9a2-1eb9cab50702 of volume 4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a716ee73-bb7f-4ceb-bd83-5f87a5ed6243]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:52 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.513s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:52 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9
Sep 12 21:03:52 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:52 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4
Sep 12 21:03:52 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:52 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.379s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Deleted volume successfully.
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4edc9c4b-7d52-4512-9f3c-7fe18a2b6090 tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-1440949d-15e9-4329-83b0-668c7e299413-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:52 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4" returned: 0 in 0.433s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 2G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:52 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 2G
Sep 12 21:03:52 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:52 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9" returned: 0 in 0.498s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:52 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9
Sep 12 21:03:52 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:53 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6.85a1890c-46ec-417a-baf6-086b880cfbe9" returned: 0 in 0.360s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-85a1890c-46ec-417a-baf6-086b880cfbe9" released by "_delete_snapshot" :: held 1.938s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-693afeb7-7dd2-42b4-b605-ee6815860df6" released by "delete_snapshot" :: held 1.974s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Created reservations ['149e04bc-8bd1-4839-b403-c73af0c0a8dc', 'fdaee25b-99e9-4e5a-80e9-c8051af3f458', 'c0b91790-c22a-4214-9e78-bf3e250b5551', '23cd96ae-e461-482a-a656-38820b23ba9f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:53 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "cinder-896450c5-796e-4fb0-ac6e-39fd1e48c64e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 2G" returned: 0 in 0.619s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a37674b-d18b-4b02-8d71-483af05d77a4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-896450c5-796e-4fb0-ac6e-39fd1e48c64e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:53 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a37674b-d18b-4b02-8d71-483af05d77a4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702
Sep 12 21:03:53 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "cinder-quobyte-896450c5-796e-4fb0-ac6e-39fd1e48c64e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Delete snapshot completed successfully.
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-quobyte-896450c5-796e-4fb0-ac6e-39fd1e48c64e" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-85a1890c-46ec-417a-baf6-086b880cfbe9-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Snapshots deleted, issuing volume delete {{(pid=87624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-693afeb7-7dd2-42b4-b605-ee6815860df6" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2091b0-72b0-44f0-8e14-323a9ed09b3f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-693afeb7-7dd2-42b4-b605-ee6815860df6" acquired by "delete_volume" :: waited 0.043s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15518ca-1ad2-49a9-ad07-acd21ed4b5ec]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:53 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e
Sep 12 21:03:53 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:53 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:53 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:53 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a37674b-d18b-4b02-8d71-483af05d77a4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702" returned: 0 in 0.436s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:53 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 is being set with open permissions: ugo+rw
Sep 12 21:03:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:53 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702
Sep 12 21:03:53 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:54 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.404s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e" returned: 0 in 0.502s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:54 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6
Sep 12 21:03:54 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e
Sep 12 21:03:54 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:54 devstack sudo[100421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info
Sep 12 21:03:54 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-693afeb7-7dd2-42b4-b605-ee6815860df6" returned: 0 in 0.265s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:54 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-896450c5-796e-4fb0-ac6e-39fd1e48c64e" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-693afeb7-7dd2-42b4-b605-ee6815860df6" released by "delete_volume" :: held 0.768s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-quobyte-896450c5-796e-4fb0-ac6e-39fd1e48c64e" released by "delete_volume" :: held 0.843s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Created reservations ['dc1cd092-0d4e-4b29-b425-57d222a4277a', '8b4899c5-e145-484b-ae34-f2e655a03843', '3cfc8225-4652-4a04-85b2-604d4797b7bc', 'ccd45b41-600f-4e36-a091-af3b9dc90f03'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Created reservations ['81a2d300-1ca4-461f-8358-0ea7eccbb5ca', '54682645-52b2-45f0-a527-3df6f9517b37', '7b6213f8-4007-4c6b-be2d-1491cbaf46bb', 'bb4bf208-6f02-48f2-9449-defa720f966c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:54 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info" returned: 0 in 0.306s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:54 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info is being set with open permissions: ugo+rw
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:54 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info
Sep 12 21:03:54 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:54 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:54 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:54 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:54 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-1b264971-f58a-404b-a448-1a339d9c05c4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-1b264971-f58a-404b-a448-1a339d9c05c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "cinder-quobyte-1b264971-f58a-404b-a448-1a339d9c05c4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-1b264971-f58a-404b-a448-1a339d9c05c4" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2679312-230c-43e3-9029-22d47c3008f6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:55 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.459s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:55 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Deleted volume successfully.
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.info" returned: 0 in 0.558s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:55 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f5d7c9b2-d601-4e54-a0ee-4137fd67080b tempest-AttachVolumeNegativeTest-234808514 None] Lock "cinder-896450c5-796e-4fb0-ac6e-39fd1e48c64e-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Deleted volume successfully.
Sep 12 21:03:55 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4
Sep 12 21:03:55 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f6643026-63a5-42ae-9557-216dc3c1b2a3 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Create snapshot completed successfully
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d7a1af4d-0996-42ee-ad6b-5a10599f6231 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-693afeb7-7dd2-42b4-b605-ee6815860df6-delete_volume" released by "delete_volume" :: held 3.980s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:55 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4" returned: 0 in 0.475s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:55 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4
Sep 12 21:03:55 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "cinder-10e59b9b-9367-4590-a9a2-1eb9cab50702-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-10e59b9b-9367-4590-a9a2-1eb9cab50702-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "cinder-quobyte-4a37674b-d18b-4b02-8d71-483af05d77a4" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-quobyte-4a37674b-d18b-4b02-8d71-483af05d77a4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "cinder-quobyte-10e59b9b-9367-4590-a9a2-1eb9cab50702" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-quobyte-10e59b9b-9367-4590-a9a2-1eb9cab50702" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Deleting offline snapshot 10e59b9b-9367-4590-a9a2-1eb9cab50702 of volume 4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] snapshot_file for this snap is: volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[14183c12-a0ba-4bc6-8d0a-487824a47cc7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:55 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b264971-f58a-404b-a448-1a339d9c05c4" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-quobyte-1b264971-f58a-404b-a448-1a339d9c05c4" released by "delete_volume" :: held 0.940s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:56 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702
Sep 12 21:03:56 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Created reservations ['db2cc70e-8a49-4136-bee0-319be648cedc', '1d6aafae-90ed-43f9-9c0a-97a9a1042cd4', '1847170c-eb05-407c-890c-1377be58c2d3', 'fbf2957a-84d8-4871-82d8-f852bfed2458'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:56 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:56 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:56 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702" returned: 0 in 0.522s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a37674b-d18b-4b02-8d71-483af05d77a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9969a0-cacd-4d5f-8615-e72b8a424a87]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:56 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Deleted volume successfully.
Sep 12 21:03:56 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4
Sep 12 21:03:56 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c85d446-80de-48f2-912e-c61ebd23d408 tempest-VolumesDeleteCascade-1016224806 None] Lock "cinder-1b264971-f58a-404b-a448-1a339d9c05c4-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:56 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4" returned: 0 in 0.435s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:56 devstack sudo[100458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702
Sep 12 21:03:56 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:57 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702" returned: 0 in 0.414s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:57 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702
Sep 12 21:03:57 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:57 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4.10e59b9b-9367-4590-a9a2-1eb9cab50702" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-quobyte-10e59b9b-9367-4590-a9a2-1eb9cab50702" released by "_delete_snapshot" :: held 1.798s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-quobyte-4a37674b-d18b-4b02-8d71-483af05d77a4" released by "delete_snapshot" :: held 1.843s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Created reservations ['d987f790-4b4d-4136-ad38-f46c60869e84', 'c7a37317-d071-4737-9f89-377000ca8b93', '079ad86b-a11a-45c2-bd8c-9c00242ecdbc', '30c2dedf-879f-441f-acea-1b9de2eec029'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Delete snapshot completed successfully.
Sep 12 21:03:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-12d832d2-b9e1-4a66-808a-39b9e4b14d67 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-10e59b9b-9367-4590-a9a2-1eb9cab50702-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "cinder-4a37674b-d18b-4b02-8d71-483af05d77a4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-4a37674b-d18b-4b02-8d71-483af05d77a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "cinder-quobyte-4a37674b-d18b-4b02-8d71-483af05d77a4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-quobyte-4a37674b-d18b-4b02-8d71-483af05d77a4" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e24baa-50ef-4988-8553-b4d383e9d9e1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:58 devstack sudo[100469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4
Sep 12 21:03:58 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:58 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4" returned: 0 in 0.453s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:58 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4
Sep 12 21:03:58 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:58 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4a37674b-d18b-4b02-8d71-483af05d77a4" returned: 0 in 0.257s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-quobyte-4a37674b-d18b-4b02-8d71-483af05d77a4" released by "delete_volume" :: held 0.788s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:03:58 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Created reservations ['35854897-2e74-4945-8c19-d3a125c8e031', '12a9ebe8-2b90-4acf-add3-bd2ceb5448a9', 'f579f116-f0b5-4f3c-8235-90c3c4816a2d', 'e8a0a2cf-ebe6-4306-992c-925aec28fb6b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:03:59 devstack sudo[100512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:03:59 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:03:59 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.323s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:03:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Deleted volume successfully.
Sep 12 21:03:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4dffcf35-8b04-439b-bdd3-ad90c25bd467 tempest-VolumesSnapshotNegativeTestJSON-1522108950 None] Lock "cinder-4a37674b-d18b-4b02-8d71-483af05d77a4-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Flow 'volume_create_manager' (7e522ae4-11cc-44b2-a4e6-7ccfb77e86d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df6b83e-c9f3-4e7b-835b-add6073c489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df6b83e-c9f3-4e7b-835b-add6073c489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1221004739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6627f680-3460-410e-9e36-90608574fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1927c8a4e8d547218fce3455b5955a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:03Z,use_quota=True,user_id='1e69a61775994297ad6463c67354bbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496b7cf0-b88f-4a94-a169-72c5b78e40de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496b7cf0-b88f-4a94-a169-72c5b78e40de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8fdd38-dca5-475b-a65a-faf37920aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8fdd38-dca5-475b-a65a-faf37920aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6627f680-3460-410e-9e36-90608574fe8e', 'volume_name': 'volume-6627f680-3460-410e-9e36-90608574fe8e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447a644-7167-4b46-b525-ec5fc477fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447a644-7167-4b46-b525-ec5fc477fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b435d8a7-5c6d-4f00-8735-31e40f322ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:02 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Volume 6627f680-3460-410e-9e36-90608574fe8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6627f680-3460-410e-9e36-90608574fe8e', 'volume_size': 1}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1221004739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6627f680-3460-410e-9e36-90608574fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1927c8a4e8d547218fce3455b5955a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:03Z,use_quota=True,user_id='1e69a61775994297ad6463c67354bbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Creating volume 6627f680-3460-410e-9e36-90608574fe8e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:02 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:02 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e 1073741824
Sep 12 21:04:02 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:03 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e 1073741824" returned: 0 in 0.573s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:03 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e
Sep 12 21:04:03 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:03 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b435d8a7-5c6d-4f00-8735-31e40f322ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6627f680-3460-410e-9e36-90608574fe8e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd145a4-cb96-42dd-ab6f-6a781162b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Volume volume-6627f680-3460-410e-9e36-90608574fe8e (6627f680-3460-410e-9e36-90608574fe8e): created successfully
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd145a4-cb96-42dd-ab6f-6a781162b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Flow 'volume_create_manager' (7e522ae4-11cc-44b2-a4e6-7ccfb77e86d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d0b9d62e-e874-43c7-8439-af0192256ee5 tempest-VolumesMetadataTest-532798284 None] Created volume successfully.
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (d1a03dcc-da44-4249-ad9f-aaecef7d5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adf6d25-d3ed-499c-a839-f6a27507fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adf6d25-d3ed-499c-a839-f6a27507fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121145895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818bce61-cf3d-477a-9a8a-e196114e8cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:05Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f63fd6-3b92-4c50-9c46-a7f13b9ed9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f63fd6-3b92-4c50-9c46-a7f13b9ed9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2df364-f463-4437-ad4e-e1f272238918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2df364-f463-4437-ad4e-e1f272238918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818bce61-cf3d-477a-9a8a-e196114e8cac', 'volume_name': 'volume-818bce61-cf3d-477a-9a8a-e196114e8cac', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceac6435-d400-40f0-970f-c109800420af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceac6435-d400-40f0-970f-c109800420af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78854c7b-4420-4c39-aab3-f9d5a51eee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume 818bce61-cf3d-477a-9a8a-e196114e8cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818bce61-cf3d-477a-9a8a-e196114e8cac', 'volume_size': 1}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121145895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818bce61-cf3d-477a-9a8a-e196114e8cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:05Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Creating volume 818bce61-cf3d-477a-9a8a-e196114e8cac {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:04 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:04 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac 1073741824
Sep 12 21:04:04 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:05 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac 1073741824" returned: 0 in 0.861s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:05 devstack sudo[100532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac
Sep 12 21:04:05 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:06 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac" returned: 0 in 0.497s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78854c7b-4420-4c39-aab3-f9d5a51eee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818bce61-cf3d-477a-9a8a-e196114e8cac', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cd2694-be42-4ac1-a78f-e6543b052b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:06 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume volume-818bce61-cf3d-477a-9a8a-e196114e8cac (818bce61-cf3d-477a-9a8a-e196114e8cac): created successfully
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cd2694-be42-4ac1-a78f-e6543b052b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (d1a03dcc-da44-4249-ad9f-aaecef7d5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b2676903-99b8-46b5-9048-05d8530906e7 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created volume successfully.
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Acquiring lock "cinder-6627f680-3460-410e-9e36-90608574fe8e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Lock "cinder-6627f680-3460-410e-9e36-90608574fe8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Acquiring lock "cinder-quobyte-6627f680-3460-410e-9e36-90608574fe8e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Lock "cinder-quobyte-6627f680-3460-410e-9e36-90608574fe8e" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a6ca8-7bbb-4516-9efd-0f3eb41b74e1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:06 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e
Sep 12 21:04:06 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:07 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e" returned: 0 in 0.457s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:07 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e
Sep 12 21:04:07 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:07 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6627f680-3460-410e-9e36-90608574fe8e" returned: 0 in 0.460s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Lock "cinder-quobyte-6627f680-3460-410e-9e36-90608574fe8e" released by "delete_volume" :: held 0.992s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (92c9f130-6c16-44c3-935c-7509b28994ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6beed65-091d-4a0e-8b95-9d77c92f18e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6beed65-091d-4a0e-8b95-9d77c92f18e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810098989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf9f73e-e54c-4c7e-b269-c3f292c0331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:08Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f7a225-cef2-48ed-aa61-610901a9afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f7a225-cef2-48ed-aa61-610901a9afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b68ab63-af2a-40b4-a03b-f8ea901fb103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b68ab63-af2a-40b4-a03b-f8ea901fb103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf9f73e-e54c-4c7e-b269-c3f292c0331c', 'volume_name': 'volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1478e6d-d7e6-42f6-b4c2-6c77a5bb280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1478e6d-d7e6-42f6-b4c2-6c77a5bb280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c6b630-59a1-4707-a578-f793cb87d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume 8bf9f73e-e54c-4c7e-b269-c3f292c0331c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c', 'volume_size': 1}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1810098989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf9f73e-e54c-4c7e-b269-c3f292c0331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:08Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Creating volume 8bf9f73e-e54c-4c7e-b269-c3f292c0331c {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:07 devstack sudo[100544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c 1073741824
Sep 12 21:04:07 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:07 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Created reservations ['bec5c8e3-aa56-42b1-a35a-49bb6fc5f7e7', '29330ed0-2646-449c-9fbc-edea2b085327', 'b66f18b9-aed3-43fa-b9f4-a2cef1d964bd', 'd2f1aade-3d25-49b6-b994-1072e388eddd'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:08 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:08 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (f4c3982f-8ffb-466a-8815-f513f51d5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c601d-7750-4047-9480-750d81b89bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c601d-7750-4047-9480-750d81b89bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1744451082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1180c905-7364-4c13-a151-06dedd782afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:08Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfc1e06-a87c-4679-92cd-579e8971f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfc1e06-a87c-4679-92cd-579e8971f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2df867-654b-4869-a13e-372b00495969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2df867-654b-4869-a13e-372b00495969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1180c905-7364-4c13-a151-06dedd782afa', 'volume_name': 'volume-1180c905-7364-4c13-a151-06dedd782afa', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b789ee-f05e-4dff-ac8e-2da6408c166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b789ee-f05e-4dff-ac8e-2da6408c166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0ffc85-e4cf-4039-8464-40fc02ee23e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume 1180c905-7364-4c13-a151-06dedd782afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1180c905-7364-4c13-a151-06dedd782afa', 'volume_size': 1}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:08 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.443s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:08 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c 1073741824" returned: 0 in 0.719s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Deleted volume successfully.
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4317a344-a776-4246-b4f2-32ce75ec3f13 tempest-VolumesMetadataTest-532798284 None] Lock "cinder-6627f680-3460-410e-9e36-90608574fe8e-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:08 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c
Sep 12 21:04:08 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (adab305d-b36b-48da-a29d-169a47dd1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440017d5-573b-46ac-9ae7-6f2c2776bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8217ecb0-2bc8-44e1-83a6-704b9e44f3a7 tempest-BackendsCapabilitiesAdminTestsJSON-186709441 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1777687072754, 'free_capacity_gb': 1773.1777687072754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87624) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440017d5-573b-46ac-9ae7-6f2c2776bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034787984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625353bc-e52a-41ef-b321-e416947b1768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:09Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0524849-50a3-4202-b9ad-4112d0e8e56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0524849-50a3-4202-b9ad-4112d0e8e56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a35332d-76cd-49e9-9faa-38367677292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a35332d-76cd-49e9-9faa-38367677292f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625353bc-e52a-41ef-b321-e416947b1768', 'volume_name': 'volume-625353bc-e52a-41ef-b321-e416947b1768', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c09df6-1075-456a-a3b8-ce984c3d429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c09df6-1075-456a-a3b8-ce984c3d429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10b3b3f-669f-49c6-9e49-7fdd06d3dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume 625353bc-e52a-41ef-b321-e416947b1768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625353bc-e52a-41ef-b321-e416947b1768', 'volume_size': 1}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac81c25-5803-42e8-887d-61ec7fa24ddb tempest-BackendsCapabilitiesAdminTestsJSON-186709441 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1777687072754, 'free_capacity_gb': 1773.1777687072754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87624) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c" returned: 0 in 0.542s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1744451082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1180c905-7364-4c13-a151-06dedd782afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:08Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Creating volume 1180c905-7364-4c13-a151-06dedd782afa {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:09 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c6b630-59a1-4707-a578-f793cb87d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4c7265-cba6-448c-acad-3538890ba550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa 1073741824
Sep 12 21:04:09 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c (8bf9f73e-e54c-4c7e-b269-c3f292c0331c): created successfully
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4c7265-cba6-448c-acad-3538890ba550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (92c9f130-6c16-44c3-935c-7509b28994ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c3b380e-ece2-4486-898d-f1118b35ac05 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created volume successfully.
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (9422df33-9b99-46ee-bbca-9cc727fdb526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32d8963-9c4b-4bda-9041-86b01d359522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32d8963-9c4b-4bda-9041-86b01d359522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219328665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb555076-b318-4f4f-ad88-e0780cc908cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:09Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a7b96f-fe68-4fc8-8168-832414786857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a7b96f-fe68-4fc8-8168-832414786857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b79d2d-4922-40ce-8380-4043132659d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b79d2d-4922-40ce-8380-4043132659d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb555076-b318-4f4f-ad88-e0780cc908cf', 'volume_name': 'volume-cb555076-b318-4f4f-ad88-e0780cc908cf', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58873af-20bd-4940-9d1c-4bfeff7dcbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58873af-20bd-4940-9d1c-4bfeff7dcbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a608c3f-271f-4ef6-a319-e64f6b1d94c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume cb555076-b318-4f4f-ad88-e0780cc908cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb555076-b318-4f4f-ad88-e0780cc908cf', 'volume_size': 1}
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:09 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa 1073741824" returned: 0 in 0.676s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:10 devstack sudo[100563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa
Sep 12 21:04:10 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (fc5496a7-abc3-495a-bd0a-6ae8844a4055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c7f5da-ab02-4b9b-87ae-8c6501f6a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c7f5da-ab02-4b9b-87ae-8c6501f6a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575656787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b11c39-e68a-4570-b71e-de5ad68c192c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:10Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef55087-9e44-4383-96b3-8013716d2f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef55087-9e44-4383-96b3-8013716d2f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc99ed2f-9355-4598-9c19-588b49303266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc99ed2f-9355-4598-9c19-588b49303266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b11c39-e68a-4570-b71e-de5ad68c192c', 'volume_name': 'volume-05b11c39-e68a-4570-b71e-de5ad68c192c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4d31e9-49be-4637-aea9-8bea69a381fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4d31e9-49be-4637-aea9-8bea69a381fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3041d4-d251-44d6-a5a1-c2798355ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume 05b11c39-e68a-4570-b71e-de5ad68c192c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b11c39-e68a-4570-b71e-de5ad68c192c', 'volume_size': 1}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:10 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa" returned: 0 in 0.296s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034787984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625353bc-e52a-41ef-b321-e416947b1768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:09Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Creating volume 625353bc-e52a-41ef-b321-e416947b1768 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:10 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0ffc85-e4cf-4039-8464-40fc02ee23e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1180c905-7364-4c13-a151-06dedd782afa', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5de5b6-ec81-4d83-9f24-be09ad44db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:10 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768 1073741824
Sep 12 21:04:10 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume volume-1180c905-7364-4c13-a151-06dedd782afa (1180c905-7364-4c13-a151-06dedd782afa): created successfully
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5de5b6-ec81-4d83-9f24-be09ad44db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (f4c3982f-8ffb-466a-8815-f513f51d5c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c36d2be1-0a5c-4379-8612-acfa973c083f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created volume successfully.
Sep 12 21:04:10 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768 1073741824" returned: 0 in 0.494s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:10 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768
Sep 12 21:04:10 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:11 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768" returned: 0 in 0.419s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.722s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219328665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb555076-b318-4f4f-ad88-e0780cc908cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:09Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Creating volume cb555076-b318-4f4f-ad88-e0780cc908cf {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:11 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10b3b3f-669f-49c6-9e49-7fdd06d3dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625353bc-e52a-41ef-b321-e416947b1768', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:11 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf 1073741824
Sep 12 21:04:11 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92bea031-ed5c-46d3-bc31-a2dca87daa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:11 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume volume-625353bc-e52a-41ef-b321-e416947b1768 (625353bc-e52a-41ef-b321-e416947b1768): created successfully
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92bea031-ed5c-46d3-bc31-a2dca87daa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (adab305d-b36b-48da-a29d-169a47dd1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e46d3ebc-dd8b-43ec-ba7f-96d46df8c51b tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created volume successfully.
Sep 12 21:04:11 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf 1073741824" returned: 0 in 0.528s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:11 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf
Sep 12 21:04:11 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:12 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf" returned: 0 in 0.343s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575656787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b11c39-e68a-4570-b71e-de5ad68c192c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeb511428fc4826a81daf8a32034553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:10Z,use_quota=True,user_id='da00c937cfef4f00a27dc273e2f77c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Creating volume 05b11c39-e68a-4570-b71e-de5ad68c192c {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:12 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a608c3f-271f-4ef6-a319-e64f6b1d94c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb555076-b318-4f4f-ad88-e0780cc908cf', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450b9b8e-06d9-4f29-8413-d18fd971baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:12 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c 1073741824
Sep 12 21:04:12 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:12 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume volume-cb555076-b318-4f4f-ad88-e0780cc908cf (cb555076-b318-4f4f-ad88-e0780cc908cf): created successfully
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450b9b8e-06d9-4f29-8413-d18fd971baad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (9422df33-9b99-46ee-bbca-9cc727fdb526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d4d11113-5eeb-404b-95c0-78b98fb2b075 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created volume successfully.
Sep 12 21:04:12 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c 1073741824" returned: 0 in 0.580s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:12 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c
Sep 12 21:04:12 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:13 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c" returned: 0 in 0.342s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3041d4-d251-44d6-a5a1-c2798355ee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b11c39-e68a-4570-b71e-de5ad68c192c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26608415-a61b-4db2-9682-f120501423ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Volume volume-05b11c39-e68a-4570-b71e-de5ad68c192c (05b11c39-e68a-4570-b71e-de5ad68c192c): created successfully
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26608415-a61b-4db2-9682-f120501423ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Flow 'volume_create_manager' (fc5496a7-abc3-495a-bd0a-6ae8844a4055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5aa52336-1594-41a9-81d3-83e649f97dec tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created volume successfully.
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-05b11c39-e68a-4570-b71e-de5ad68c192c-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-05b11c39-e68a-4570-b71e-de5ad68c192c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-quobyte-05b11c39-e68a-4570-b71e-de5ad68c192c" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-05b11c39-e68a-4570-b71e-de5ad68c192c" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78daa59-115b-419a-a26a-9d4e2a727f8d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:13 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c
Sep 12 21:04:13 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:14 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c" returned: 0 in 0.429s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:14 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c
Sep 12 21:04:14 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:14 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-05b11c39-e68a-4570-b71e-de5ad68c192c" returned: 0 in 0.490s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-05b11c39-e68a-4570-b71e-de5ad68c192c" released by "delete_volume" :: held 0.991s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created reservations ['588dce4e-c22f-4d7b-82f3-1ed72aee7078', '572a24eb-7ecb-4db6-ac4b-756824eb719b', 'd219d9cd-c4f5-4ea7-af50-96d3843e1938', '1db2f65b-e845-4c21-81e7-d96bee78ac0c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:14 devstack sudo[100603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:14 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:15 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.434s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:15 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Deleted volume successfully.
Sep 12 21:04:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec92663f-7842-489e-b4ab-9cdcfe0e6df4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-05b11c39-e68a-4570-b71e-de5ad68c192c-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-cb555076-b318-4f4f-ad88-e0780cc908cf-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-cb555076-b318-4f4f-ad88-e0780cc908cf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-quobyte-cb555076-b318-4f4f-ad88-e0780cc908cf" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-cb555076-b318-4f4f-ad88-e0780cc908cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa16e6-3107-49a8-8f19-5b8efd2f41f8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:16 devstack sudo[100606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf
Sep 12 21:04:16 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:16 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf" returned: 0 in 0.616s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:16 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf
Sep 12 21:04:16 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:17 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Flow 'volume_create_manager' (09189225-5c05-45d1-ad2e-06775abba6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516a5338-7eef-479c-8980-dd41937e84ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cb555076-b318-4f4f-ad88-e0780cc908cf" returned: 0 in 0.475s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516a5338-7eef-479c-8980-dd41937e84ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-974971088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed462fd19346b2a4c1c23c2d34826a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:17Z,use_quota=True,user_id='26a5c217780440ad9771cfe9bbedfecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2741329a-98a5-4ec4-8651-e1a85c33e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2741329a-98a5-4ec4-8651-e1a85c33e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb051e5-84b9-4525-91c7-330d45fd8113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb051e5-84b9-4525-91c7-330d45fd8113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73', 'volume_name': 'volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6580b44a-42b8-46b1-b983-8358cbd817b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6580b44a-42b8-46b1-b983-8358cbd817b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4120d14a-2b43-4f9a-8559-ead6f5e5a613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Volume 47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73', 'volume_size': 1}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-974971088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed462fd19346b2a4c1c23c2d34826a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:17Z,use_quota=True,user_id='26a5c217780440ad9771cfe9bbedfecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Creating volume 47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:17 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-cb555076-b318-4f4f-ad88-e0780cc908cf" released by "delete_volume" :: held 1.260s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:17 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 1073741824
Sep 12 21:04:17 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created reservations ['823a7f2c-7f73-41f0-a000-c61895f5817a', '4915a6f7-f95e-4b2c-bff0-e4eb2f6e61ec', '85300bc1-275d-491f-98c9-84f12fa770bf', '8e936abd-4af0-40a6-bdf8-692a8c7dab13'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:17 devstack sudo[100616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:17 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:17 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.394s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Deleted volume successfully.
Sep 12 21:04:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-55664328-8779-4cd6-aadf-1c5cad342e0e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-cb555076-b318-4f4f-ad88-e0780cc908cf-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:18 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 1073741824" returned: 0 in 0.807s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:18 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73
Sep 12 21:04:18 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-625353bc-e52a-41ef-b321-e416947b1768-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-625353bc-e52a-41ef-b321-e416947b1768-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-quobyte-625353bc-e52a-41ef-b321-e416947b1768" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-625353bc-e52a-41ef-b321-e416947b1768" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775738e-97af-4446-84ab-3a8808426ddc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:18 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73" returned: 0 in 0.524s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:18 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768
Sep 12 21:04:18 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4120d14a-2b43-4f9a-8559-ead6f5e5a613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56de442d-218b-4b9c-8aa9-7c6e4670b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:18 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Volume volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 (47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73): created successfully
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56de442d-218b-4b9c-8aa9-7c6e4670b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Flow 'volume_create_manager' (09189225-5c05-45d1-ad2e-06775abba6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-92d601d8-e10e-4a65-9348-6de162842302 tempest-VolumesTransfersV357Test-2057932259 None] Created volume successfully.
Sep 12 21:04:19 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768" returned: 0 in 0.550s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:19 devstack sudo[100636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768
Sep 12 21:04:19 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:19 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-625353bc-e52a-41ef-b321-e416947b1768" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-625353bc-e52a-41ef-b321-e416947b1768" released by "delete_volume" :: held 1.024s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created reservations ['28fe58b4-003a-4363-9dc3-5de2fed4b72a', '35492a51-a416-471c-a53d-33c3e50bd0ef', 'f83449e4-5101-401b-a561-525e9cfe66d8', '3124a2bc-a1b3-4879-9af6-703d5fe2eba5'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:19 devstack sudo[100639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:19 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:20 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.406s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Deleted volume successfully.
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c391ce50-9ff6-4216-9817-f1f5cb32440f tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-625353bc-e52a-41ef-b321-e416947b1768-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2e4c34e8-b8e8-4cbd-b327-3af68f6d6c93 tempest-VolumesTransfersV357Test-1178141205 None] Transfer volume completed successfully.
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-1180c905-7364-4c13-a151-06dedd782afa-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-1180c905-7364-4c13-a151-06dedd782afa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-quobyte-1180c905-7364-4c13-a151-06dedd782afa" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-1180c905-7364-4c13-a151-06dedd782afa" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ece3fa-8296-43db-ac58-3a4b23a5444f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:20 devstack sudo[100643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa
Sep 12 21:04:20 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:21 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa" returned: 0 in 0.472s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:21 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa
Sep 12 21:04:21 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Acquiring lock "cinder-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Acquiring lock "cinder-quobyte-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-quobyte-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[36838983-b68c-4d9c-a9b2-8624113094f8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:21 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1180c905-7364-4c13-a151-06dedd782afa" returned: 0 in 0.317s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-1180c905-7364-4c13-a151-06dedd782afa" released by "delete_volume" :: held 0.863s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=204,cinder:SELECT=172,cinder:INSERT=50,cinder:DELETE=13 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:04:21 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73
Sep 12 21:04:21 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created reservations ['78ac6c87-1d4c-4f37-8a68-df49bc1fbb77', '174f64b3-ba1d-42cb-9711-baff5a018903', 'b0fe6312-7527-42f3-9839-4a704b2abda9', '602acbee-6175-4786-9c56-b48f2f346dd1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:21 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:21 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:22 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73" returned: 0 in 0.501s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:22 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73
Sep 12 21:04:22 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:22 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.336s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Deleted volume successfully.
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f31de99-047b-4d96-9971-4c7d08e5043e tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-1180c905-7364-4c13-a151-06dedd782afa-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:22 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73" returned: 0 in 0.291s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-quobyte-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73" released by "delete_volume" :: held 0.845s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Created reservations ['ca1d63da-58f4-4322-b2fe-b8bf37eca8dc', '6170b194-358a-4bc0-94d7-c3b5d5bdacd4', '83502e10-c83f-483d-b06f-240b9881622e', '9eefffe0-6880-478d-a3ff-731946598e5e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:22 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:22 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:22 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Flow 'volume_create_manager' (bfe6ed34-d17f-4268-a62e-2fe46b24a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e6afb8-c5ed-456f-bc88-88787b3802ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.445s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Deleted volume successfully.
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e6afb8-c5ed-456f-bc88-88787b3802ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1990544105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd11adb7-b990-4e61-9906-8c07177cecef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a79d1ccb4a4dbd889a0037edcbf10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:23Z,use_quota=True,user_id='6aeabbf1580e46d0b7155c8e0e7af1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21798a7c-6d21-4fd9-8b28-87be05e14dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21798a7c-6d21-4fd9-8b28-87be05e14dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed1b3f3-e799-4fd6-9ae2-80ac2ec7976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed1b3f3-e799-4fd6-9ae2-80ac2ec7976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd11adb7-b990-4e61-9906-8c07177cecef', 'volume_name': 'volume-bd11adb7-b990-4e61-9906-8c07177cecef', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd726d5f-bb61-4786-8b51-29df08884347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd726d5f-bb61-4786-8b51-29df08884347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e233c2c1-2289-4d9c-b6fd-baefe9aa58de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:23 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Volume bd11adb7-b990-4e61-9906-8c07177cecef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd11adb7-b990-4e61-9906-8c07177cecef', 'volume_size': 1}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1990544105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd11adb7-b990-4e61-9906-8c07177cecef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a79d1ccb4a4dbd889a0037edcbf10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:23Z,use_quota=True,user_id='6aeabbf1580e46d0b7155c8e0e7af1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Creating volume bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:23 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-8bf9f73e-e54c-4c7e-b269-c3f292c0331c-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-8bf9f73e-e54c-4c7e-b269-c3f292c0331c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87fc9212-8267-4052-a021-cc5014f52608 tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-47fe7ec4-dc1e-436f-9eb0-f70cfb14eb73-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:23 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef 1073741824
Sep 12 21:04:23 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-quobyte-8bf9f73e-e54c-4c7e-b269-c3f292c0331c" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-8bf9f73e-e54c-4c7e-b269-c3f292c0331c" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa85a14a-bacb-46d5-86db-8d7fcd768813]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:23 devstack sudo[100668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c
Sep 12 21:04:23 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Flow 'volume_create_manager' (eedfa8c4-59ac-42e3-8cf1-f51f4b78e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512b9334-2bdc-43c1-a8d7-9cd1fde440a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512b9334-2bdc-43c1-a8d7-9cd1fde440a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1280223479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591295e6-ea59-46d3-aa9b-8a568436609a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed462fd19346b2a4c1c23c2d34826a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:23Z,use_quota=True,user_id='26a5c217780440ad9771cfe9bbedfecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8642606f-4bb0-41fd-bf02-c5087ffbba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8642606f-4bb0-41fd-bf02-c5087ffbba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb5d269-419e-45ca-922e-1b906c795b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb5d269-419e-45ca-922e-1b906c795b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591295e6-ea59-46d3-aa9b-8a568436609a', 'volume_name': 'volume-591295e6-ea59-46d3-aa9b-8a568436609a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fe593a-0749-4361-a7cc-8ba7c10c784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fe593a-0749-4361-a7cc-8ba7c10c784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa4848a-af33-4a6e-8c0d-4e18343841e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:23 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Volume 591295e6-ea59-46d3-aa9b-8a568436609a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591295e6-ea59-46d3-aa9b-8a568436609a', 'volume_size': 1}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:23 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef 1073741824" returned: 0 in 0.633s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:23 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c" returned: 0 in 0.458s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:23 devstack sudo[100678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c
Sep 12 21:04:23 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:23 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:04:23 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:24 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bf9f73e-e54c-4c7e-b269-c3f292c0331c" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-8bf9f73e-e54c-4c7e-b269-c3f292c0331c" released by "delete_volume" :: held 0.851s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:24 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.322s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1280223479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591295e6-ea59-46d3-aa9b-8a568436609a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed462fd19346b2a4c1c23c2d34826a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:23Z,use_quota=True,user_id='26a5c217780440ad9771cfe9bbedfecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Creating volume 591295e6-ea59-46d3-aa9b-8a568436609a {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:24 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:24 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a 1073741824
Sep 12 21:04:24 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e233c2c1-2289-4d9c-b6fd-baefe9aa58de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd11adb7-b990-4e61-9906-8c07177cecef', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794cad40-fbcd-428e-bd6e-7696d910a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:24 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Volume volume-bd11adb7-b990-4e61-9906-8c07177cecef (bd11adb7-b990-4e61-9906-8c07177cecef): created successfully
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794cad40-fbcd-428e-bd6e-7696d910a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Flow 'volume_create_manager' (bfe6ed34-d17f-4268-a62e-2fe46b24a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-329e7d11-d3c1-47f3-b6b7-e9f6d4086fb3 tempest-TestStampPattern-212468362 None] Created volume successfully.
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created reservations ['96714ca6-844c-4027-bce3-d6250752a343', '61f7c50d-00cb-408e-ac6e-2d0ba25e3b9f', '47018c97-a1ae-484d-bb59-c2c7ede7d345', '71783944-83ec-492e-acf6-d751e5cf808b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:24 devstack sudo[100687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:24 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:24 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a 1073741824" returned: 0 in 0.571s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:24 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Deleted volume successfully.
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5de95fd6-369c-44f7-a982-64acfc2ca8f6 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-8bf9f73e-e54c-4c7e-b269-c3f292c0331c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:24 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a
Sep 12 21:04:24 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:25 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a" returned: 0 in 0.334s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa4848a-af33-4a6e-8c0d-4e18343841e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591295e6-ea59-46d3-aa9b-8a568436609a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbb0f82-4939-42ae-a4b3-23adeca9db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:25 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Volume volume-591295e6-ea59-46d3-aa9b-8a568436609a (591295e6-ea59-46d3-aa9b-8a568436609a): created successfully
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbb0f82-4939-42ae-a4b3-23adeca9db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Flow 'volume_create_manager' (eedfa8c4-59ac-42e3-8cf1-f51f4b78e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-922072c8-28b4-469a-9694-16b9b1f69621 tempest-VolumesTransfersV357Test-2057932259 None] Created volume successfully.
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-818bce61-cf3d-477a-9a8a-e196114e8cac-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-818bce61-cf3d-477a-9a8a-e196114e8cac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "cinder-quobyte-818bce61-cf3d-477a-9a8a-e196114e8cac" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-818bce61-cf3d-477a-9a8a-e196114e8cac" acquired by "delete_volume" :: waited 0.033s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[27556fd4-4e09-4474-8ece-a926a371d8f5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:25 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac
Sep 12 21:04:25 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Acquiring lock "cinder-591295e6-ea59-46d3-aa9b-8a568436609a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-591295e6-ea59-46d3-aa9b-8a568436609a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:26 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac" returned: 0 in 0.591s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0310c764-2881-4bc6-9a9e-f7798325f993 tempest-GroupsTest-1056394440 None] Group tempest-Group1-536025427: creating
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Acquiring lock "cinder-quobyte-591295e6-ea59-46d3-aa9b-8a568436609a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:26 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac
Sep 12 21:04:26 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-quobyte-591295e6-ea59-46d3-aa9b-8a568436609a" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ebad5-ae96-4873-801f-374b41ff0f8f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0310c764-2881-4bc6-9a9e-f7798325f993 tempest-GroupsTest-1056394440 None] Group tempest-Group1-536025427: created successfully
Sep 12 21:04:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0310c764-2881-4bc6-9a9e-f7798325f993 tempest-GroupsTest-1056394440 None] Create group completed successfully.
Sep 12 21:04:26 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a
Sep 12 21:04:26 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:26 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-818bce61-cf3d-477a-9a8a-e196114e8cac" returned: 0 in 0.418s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-quobyte-818bce61-cf3d-477a-9a8a-e196114e8cac" released by "delete_volume" :: held 1.080s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Created reservations ['02465dac-af28-45b8-8b9d-e24ebf14447f', 'ef819c35-8096-434f-afcc-d07c56fbeed1', '8289fbff-e770-46f2-b72d-e74d102d349c', 'c9a394d2-5867-46b3-8a23-c6d26b053a94'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:26 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:26 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:26 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a" returned: 0 in 0.538s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:26 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a
Sep 12 21:04:26 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:26 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.312s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Deleted volume successfully.
Sep 12 21:04:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c2aed1c-c56f-4f90-9324-2dbbb07979a4 tempest-CreateVolumesFromSourceVolumeTest-1399045468 None] Lock "cinder-818bce61-cf3d-477a-9a8a-e196114e8cac-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:27 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-591295e6-ea59-46d3-aa9b-8a568436609a" returned: 0 in 0.350s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-quobyte-591295e6-ea59-46d3-aa9b-8a568436609a" released by "delete_volume" :: held 0.970s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Created reservations ['370fe127-2cdb-419e-a2ef-131b578f8909', 'd30bf898-d3b5-4802-b242-69b27694bacb', 'bdb5190f-b83a-40bc-8722-538e3bd03b83', '4a20bdfe-4814-42da-9fb2-64caf2fab99f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:27 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:27 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2bd602d8-db7d-4b67-8078-b427662cca1c tempest-GroupsTest-1056394440 None] Group tempest-Group2-933096853: creating
Sep 12 21:04:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2bd602d8-db7d-4b67-8078-b427662cca1c tempest-GroupsTest-1056394440 None] Group tempest-Group2-933096853: created successfully
Sep 12 21:04:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2bd602d8-db7d-4b67-8078-b427662cca1c tempest-GroupsTest-1056394440 None] Create group completed successfully.
Sep 12 21:04:27 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Deleted volume successfully.
Sep 12 21:04:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-31d5878c-6856-4df0-9d23-365a13dea07c tempest-VolumesTransfersV357Test-1340813885 None] Lock "cinder-591295e6-ea59-46d3-aa9b-8a568436609a-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Flow 'volume_create_manager' (697b84e9-1b07-45d4-857e-d48f09fab116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8526c9-d080-4b39-9cf0-e72d6615910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8526c9-d080-4b39-9cf0-e72d6615910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-13900181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=96ca2f53-a47b-4037-a5b2-e3e23c93f9c2,host='devstack@QuobyteHD#QuobyteHD',id=186bbb65-96cc-4b15-b594-e28346faabd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a09527789548a7b987bdc82a53d135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:29Z,use_quota=True,user_id='94478e7bf8ad416699a79860a8470638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cf5017-7dc8-4603-82a2-31c7da00a443),volume_type_id=13cf5017-7dc8-4603-82a2-31c7da00a443)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5aacbb9-cb09-4dcd-ba63-0cc2da43d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5aacbb9-cb09-4dcd-ba63-0cc2da43d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da24d901-f5c3-4fbd-a851-c9d0175a65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da24d901-f5c3-4fbd-a851-c9d0175a65bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186bbb65-96cc-4b15-b594-e28346faabd1', 'volume_name': 'volume-186bbb65-96cc-4b15-b594-e28346faabd1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918406eb-8465-45f4-a4ba-3ca49815b47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918406eb-8465-45f4-a4ba-3ca49815b47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65019bd-a217-40ac-886f-ff0ce744e3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:29 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Volume 186bbb65-96cc-4b15-b594-e28346faabd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186bbb65-96cc-4b15-b594-e28346faabd1', 'volume_size': 1}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=96ca2f53-a47b-4037-a5b2-e3e23c93f9c2,created_at=2026-09-12T19:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-13900181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=96ca2f53-a47b-4037-a5b2-e3e23c93f9c2,host='devstack@QuobyteHD#QuobyteHD',id=186bbb65-96cc-4b15-b594-e28346faabd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a09527789548a7b987bdc82a53d135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:29Z,use_quota=True,user_id='94478e7bf8ad416699a79860a8470638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cf5017-7dc8-4603-82a2-31c7da00a443),volume_type_id=13cf5017-7dc8-4603-82a2-31c7da00a443)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Creating volume 186bbb65-96cc-4b15-b594-e28346faabd1 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:29 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:29 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1 1073741824
Sep 12 21:04:29 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:29 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1 1073741824" returned: 0 in 0.519s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:29 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1
Sep 12 21:04:29 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:30 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65019bd-a217-40ac-886f-ff0ce744e3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186bbb65-96cc-4b15-b594-e28346faabd1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752f44f8-e3da-487a-92d0-d861116bef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:30 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Volume volume-186bbb65-96cc-4b15-b594-e28346faabd1 (186bbb65-96cc-4b15-b594-e28346faabd1): created successfully
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752f44f8-e3da-487a-92d0-d861116bef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Flow 'volume_create_manager' (697b84e9-1b07-45d4-857e-d48f09fab116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-96547532-6754-468c-bec7-41b04752fc23 tempest-GroupsTest-1056394440 None] Created volume successfully.
Sep 12 21:04:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Acquiring lock "cinder-quobyte-186bbb65-96cc-4b15-b594-e28346faabd1" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Lock "cinder-quobyte-186bbb65-96cc-4b15-b594-e28346faabd1" acquired by "delete_volume" :: waited 0.044s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e05d0-661d-4a1d-b429-bf950eb5a42c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:32 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1
Sep 12 21:04:32 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:32 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1" returned: 0 in 0.785s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:32 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1
Sep 12 21:04:32 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:33 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-186bbb65-96cc-4b15-b594-e28346faabd1" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Lock "cinder-quobyte-186bbb65-96cc-4b15-b594-e28346faabd1" released by "delete_volume" :: held 1.268s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Created reservations ['9d7d6683-2787-40fa-8030-584d41609774'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:33 devstack cinder-volume[87624]: WARNING cinder.quota [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-521408338 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-521408338, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:04:33 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:33 devstack cinder-volume[87624]: WARNING cinder.quota [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-521408338 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-521408338, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:04:33 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Created reservations ['a7bdf09e-a669-4a33-8c5c-8e66b5fd8cbc', '0313d970-5984-4c2e-9d11-2c433b21f1af', '6d6f3b12-dc1d-4117-a27f-670933ad1a13', '04b99164-0587-4239-99c9-fec3a406b186'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Flow 'volume_create_manager' (84997e53-22cd-4b10-8012-1ca6c5b8c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d04240-24c9-4182-ab40-9ffd6f374af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d04240-24c9-4182-ab40-9ffd6f374af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545422071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c85bc29-8607-4751-b61c-483416e7286a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0af918b95a4235a633443958b01ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:33Z,use_quota=True,user_id='d0b4e79e3adc4f89baf7b639aeb86720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17905a5-c2f2-47e1-957a-54640abdd0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17905a5-c2f2-47e1-957a-54640abdd0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5123abef-fd89-49e0-8dc1-95d3a525a5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5123abef-fd89-49e0-8dc1-95d3a525a5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c85bc29-8607-4751-b61c-483416e7286a', 'volume_name': 'volume-7c85bc29-8607-4751-b61c-483416e7286a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2cd67e-26d5-4562-8db0-25179604cebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2cd67e-26d5-4562-8db0-25179604cebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f52d470-5fdf-406f-905f-5061a6bd2f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:33 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Volume 7c85bc29-8607-4751-b61c-483416e7286a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c85bc29-8607-4751-b61c-483416e7286a', 'volume_size': 1}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545422071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c85bc29-8607-4751-b61c-483416e7286a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0af918b95a4235a633443958b01ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:33Z,use_quota=True,user_id='d0b4e79e3adc4f89baf7b639aeb86720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Creating volume 7c85bc29-8607-4751-b61c-483416e7286a {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:33 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:33 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a 1073741824
Sep 12 21:04:33 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:33 devstack sudo[100829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:33 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:34 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.718s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:34 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:34 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.504s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:34 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0584f978-68f6-4dce-8f75-53971f8968ce tempest-GroupsTest-1056394440 None] Delete group completed successfully.
Sep 12 21:04:34 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a 1073741824" returned: 0 in 0.854s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:34 devstack sudo[100837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a
Sep 12 21:04:34 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:35 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a" returned: 0 in 0.456s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f52d470-5fdf-406f-905f-5061a6bd2f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c85bc29-8607-4751-b61c-483416e7286a', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed8d143-3291-4b4a-9fbc-0e182f924341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:35 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Volume volume-7c85bc29-8607-4751-b61c-483416e7286a (7c85bc29-8607-4751-b61c-483416e7286a): created successfully
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed8d143-3291-4b4a-9fbc-0e182f924341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Flow 'volume_create_manager' (84997e53-22cd-4b10-8012-1ca6c5b8c16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d5ebb7b5-c052-431f-bb88-0b2a906f1c11 tempest-ProjectReaderTests-1858981621 None] Created volume successfully.
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Created reservations ['cfd2bf95-f0fe-400a-8aa7-812c24087a49'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:35 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:35 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:35 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.318s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:35 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-fb32221d-654c-4461-881a-47e60f667efc tempest-GroupsTest-1056394440 None] Delete group completed successfully.
Sep 12 21:04:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "cinder-7c85bc29-8607-4751-b61c-483416e7286a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-7c85bc29-8607-4751-b61c-483416e7286a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "cinder-quobyte-7c85bc29-8607-4751-b61c-483416e7286a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-quobyte-7c85bc29-8607-4751-b61c-483416e7286a" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:36 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3920eb58-e90d-4876-b940-1aaa52bb85c6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:36 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a
Sep 12 21:04:36 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:37 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a" returned: 0 in 0.683s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:37 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a
Sep 12 21:04:37 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1008f904-0960-4aac-85c1-2b86e4a6f067 tempest-GroupsTest-1056394440 None] Group tempest-GroupsTest-Group-1946339840: creating
Sep 12 21:04:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1008f904-0960-4aac-85c1-2b86e4a6f067 tempest-GroupsTest-1056394440 None] Group tempest-GroupsTest-Group-1946339840: created successfully
Sep 12 21:04:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1008f904-0960-4aac-85c1-2b86e4a6f067 tempest-GroupsTest-1056394440 None] Create group completed successfully.
Sep 12 21:04:37 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7c85bc29-8607-4751-b61c-483416e7286a" returned: 0 in 0.422s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-quobyte-7c85bc29-8607-4751-b61c-483416e7286a" released by "delete_volume" :: held 1.176s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Created reservations ['2d3a29e0-b798-4d73-ace2-91d0ca085ee2', 'c42756d3-e503-46c5-bb2d-1f3c3506e76b', '6167f984-e4f1-4f45-a534-1e01576a1634', '2a87c1a6-3365-4471-9a3c-307d91a24427'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:38 devstack sudo[100852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:38 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:38 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.469s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:38 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Deleted volume successfully.
Sep 12 21:04:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c1bff588-a0bd-4a88-bc5a-0df27ae8acb7 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-7c85bc29-8607-4751-b61c-483416e7286a-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Flow 'volume_create_manager' (db49bae9-2afc-4b4a-9e93-cc6ac63f68ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c5b816-481b-4a11-9bcc-1513aa6ec145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c5b816-481b-4a11-9bcc-1513aa6ec145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194378421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=024ec480-3e3b-4580-a2fd-761bb1089173,host='devstack@QuobyteHD#QuobyteHD',id=e7de78a7-e712-49d9-b7f3-1010133027c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a09527789548a7b987bdc82a53d135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:39Z,use_quota=True,user_id='94478e7bf8ad416699a79860a8470638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c3b813-ca56-404a-86d2-5b25fd07fdd7),volume_type_id=04c3b813-ca56-404a-86d2-5b25fd07fdd7)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd8080b-bcf6-464f-a12b-586a11e8b275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd8080b-bcf6-464f-a12b-586a11e8b275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2022b1b5-1698-4478-82bd-69783f412d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2022b1b5-1698-4478-82bd-69783f412d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7de78a7-e712-49d9-b7f3-1010133027c9', 'volume_name': 'volume-e7de78a7-e712-49d9-b7f3-1010133027c9', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b58311-c8fe-4517-9a3a-0a356f55ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b58311-c8fe-4517-9a3a-0a356f55ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87984826-d629-43c4-8200-0783fc582089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Volume e7de78a7-e712-49d9-b7f3-1010133027c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7de78a7-e712-49d9-b7f3-1010133027c9', 'volume_size': 1}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=024ec480-3e3b-4580-a2fd-761bb1089173,created_at=2026-09-12T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1194378421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=024ec480-3e3b-4580-a2fd-761bb1089173,host='devstack@QuobyteHD#QuobyteHD',id=e7de78a7-e712-49d9-b7f3-1010133027c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a09527789548a7b987bdc82a53d135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:39Z,use_quota=True,user_id='94478e7bf8ad416699a79860a8470638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c3b813-ca56-404a-86d2-5b25fd07fdd7),volume_type_id=04c3b813-ca56-404a-86d2-5b25fd07fdd7)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Creating volume e7de78a7-e712-49d9-b7f3-1010133027c9 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:39 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (a790480c-ff4c-400c-aace-e130d1c58acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e18ba0-e4a0-4d4f-aaac-946de0700ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9 1073741824
Sep 12 21:04:39 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e18ba0-e4a0-4d4f-aaac-946de0700ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1466079647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14d5d74b-013d-4af5-8e03-38f7af03c946,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:39Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e84181b-b665-4ab9-ac62-d8f67c8990a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e84181b-b665-4ab9-ac62-d8f67c8990a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8788e97c-7b5a-4152-bb7b-1c7cd53e3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8788e97c-7b5a-4152-bb7b-1c7cd53e3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14d5d74b-013d-4af5-8e03-38f7af03c946', 'volume_name': 'volume-14d5d74b-013d-4af5-8e03-38f7af03c946', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18ef773-d128-4302-8524-4eb2812ff766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18ef773-d128-4302-8524-4eb2812ff766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dff81ea-6cea-40a6-aa61-d7dc7343cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Volume 14d5d74b-013d-4af5-8e03-38f7af03c946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14d5d74b-013d-4af5-8e03-38f7af03c946', 'volume_size': 1}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Flow 'volume_create_manager' (48934ed8-082c-492e-8e34-401ab4d2edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c67b28c-8b3c-4282-a81f-15bdacc0c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c67b28c-8b3c-4282-a81f-15bdacc0c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628492952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924a39d6-9263-481e-a455-258a54cf462c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0af918b95a4235a633443958b01ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:40Z,use_quota=True,user_id='d0b4e79e3adc4f89baf7b639aeb86720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3db049-87ce-42c7-8742-eb10276fdebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3db049-87ce-42c7-8742-eb10276fdebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3480a677-3b9d-4ece-a81e-4110de6ac2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3480a677-3b9d-4ece-a81e-4110de6ac2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924a39d6-9263-481e-a455-258a54cf462c', 'volume_name': 'volume-924a39d6-9263-481e-a455-258a54cf462c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cad24c-4226-4045-a80c-0bfebc127ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cad24c-4226-4045-a80c-0bfebc127ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c058e3ea-83d1-4b8a-85cf-0c372b91609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Volume 924a39d6-9263-481e-a455-258a54cf462c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924a39d6-9263-481e-a455-258a54cf462c', 'volume_size': 1}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:40 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9 1073741824" returned: 0 in 0.530s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:40 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9
Sep 12 21:04:40 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:40 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9" returned: 0 in 0.254s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1466079647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14d5d74b-013d-4af5-8e03-38f7af03c946,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:39Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Creating volume 14d5d74b-013d-4af5-8e03-38f7af03c946 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:40 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87984826-d629-43c4-8200-0783fc582089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7de78a7-e712-49d9-b7f3-1010133027c9', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:40 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946 1073741824
Sep 12 21:04:40 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371d9db6-e897-4dfc-acbe-40ffd4e64e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Volume volume-e7de78a7-e712-49d9-b7f3-1010133027c9 (e7de78a7-e712-49d9-b7f3-1010133027c9): created successfully
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371d9db6-e897-4dfc-acbe-40ffd4e64e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Flow 'volume_create_manager' (db49bae9-2afc-4b4a-9e93-cc6ac63f68ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2c269a7d-64c6-40f5-8861-ec49ffe7ffc8 tempest-GroupsTest-1056394440 None] Created volume successfully.
Sep 12 21:04:40 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946 1073741824" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:40 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946
Sep 12 21:04:40 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:41 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946" returned: 0 in 0.242s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628492952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924a39d6-9263-481e-a455-258a54cf462c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0af918b95a4235a633443958b01ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:40Z,use_quota=True,user_id='d0b4e79e3adc4f89baf7b639aeb86720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Creating volume 924a39d6-9263-481e-a455-258a54cf462c {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:41 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dff81ea-6cea-40a6-aa61-d7dc7343cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14d5d74b-013d-4af5-8e03-38f7af03c946', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:41 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c 1073741824
Sep 12 21:04:41 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec081e75-e2cb-4ca5-8e35-122c19794975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Volume volume-14d5d74b-013d-4af5-8e03-38f7af03c946 (14d5d74b-013d-4af5-8e03-38f7af03c946): created successfully
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec081e75-e2cb-4ca5-8e35-122c19794975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (a790480c-ff4c-400c-aace-e130d1c58acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ad6218c5-8cbc-48a9-a4a2-0f352bb139c0 tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:04:41 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c 1073741824" returned: 0 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:41 devstack sudo[100880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c
Sep 12 21:04:41 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:41 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c" returned: 0 in 0.310s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c058e3ea-83d1-4b8a-85cf-0c372b91609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924a39d6-9263-481e-a455-258a54cf462c', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231dc449-8a31-427d-a2fb-79456b7f6ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:42 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Volume volume-924a39d6-9263-481e-a455-258a54cf462c (924a39d6-9263-481e-a455-258a54cf462c): created successfully
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231dc449-8a31-427d-a2fb-79456b7f6ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Flow 'volume_create_manager' (48934ed8-082c-492e-8e34-401ab4d2edb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:42 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c630cc77-9569-435c-ab43-068fadb525c1 tempest-ProjectReaderTests-1858981621 None] Created volume successfully.
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Flow 'volume_create_manager' (85e0d8f5-0649-45da-ae32-fb02d884ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2961e7-86f8-4aee-8b55-054d7ae5869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2961e7-86f8-4aee-8b55-054d7ae5869d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-388755501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=024ec480-3e3b-4580-a2fd-761bb1089173,host='devstack@QuobyteHD#QuobyteHD',id=fec1ef2c-39d0-4165-bc8f-7d652a700fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a09527789548a7b987bdc82a53d135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:42Z,use_quota=True,user_id='94478e7bf8ad416699a79860a8470638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c3b813-ca56-404a-86d2-5b25fd07fdd7),volume_type_id=04c3b813-ca56-404a-86d2-5b25fd07fdd7)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd5aa53-16c6-4bcf-8fd7-f84d05016845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd5aa53-16c6-4bcf-8fd7-f84d05016845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9172a20c-d687-4620-8aeb-a241a9274845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9172a20c-d687-4620-8aeb-a241a9274845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec1ef2c-39d0-4165-bc8f-7d652a700fd4', 'volume_name': 'volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986bcd26-d332-41a2-b174-0d1bb5e6ed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986bcd26-d332-41a2-b174-0d1bb5e6ed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5d6f0-9bd0-41dd-b597-ed7d66cf2f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:42 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Volume fec1ef2c-39d0-4165-bc8f-7d652a700fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4', 'volume_size': 1}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=024ec480-3e3b-4580-a2fd-761bb1089173,created_at=2026-09-12T19:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-388755501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=024ec480-3e3b-4580-a2fd-761bb1089173,host='devstack@QuobyteHD#QuobyteHD',id=fec1ef2c-39d0-4165-bc8f-7d652a700fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a09527789548a7b987bdc82a53d135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:42Z,use_quota=True,user_id='94478e7bf8ad416699a79860a8470638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c3b813-ca56-404a-86d2-5b25fd07fdd7),volume_type_id=04c3b813-ca56-404a-86d2-5b25fd07fdd7)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Creating volume fec1ef2c-39d0-4165-bc8f-7d652a700fd4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:42 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:42 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 1073741824
Sep 12 21:04:42 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:42 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 1073741824" returned: 0 in 0.454s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:42 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4
Sep 12 21:04:42 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:43 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4" returned: 0 in 0.305s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5d6f0-9bd0-41dd-b597-ed7d66cf2f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88959b6-cedd-45a0-89fb-4d749ad68dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:43 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Volume volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 (fec1ef2c-39d0-4165-bc8f-7d652a700fd4): created successfully
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88959b6-cedd-45a0-89fb-4d749ad68dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Flow 'volume_create_manager' (85e0d8f5-0649-45da-ae32-fb02d884ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "cinder-924a39d6-9263-481e-a455-258a54cf462c-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2b9dce71-50d3-4346-8ed5-5242d2cea5b8 tempest-GroupsTest-1056394440 None] Created volume successfully.
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-924a39d6-9263-481e-a455-258a54cf462c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "cinder-quobyte-924a39d6-9263-481e-a455-258a54cf462c" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-quobyte-924a39d6-9263-481e-a455-258a54cf462c" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941b3e3-3d5b-45a6-97ce-76d3d95656d9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (f57b415e-e7ed-4cda-ad80-831b71dcc2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041e4fbb-c181-4141-bcb5-bb248927cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041e4fbb-c181-4141-bcb5-bb248927cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-4422778',display_name='tempest-VolumesGetTest-Volume-879013935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cb2b82-0cbb-4b77-83de-8c1c4336a347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:43Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:43 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c
Sep 12 21:04:43 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4065b3e2-2f57-47ec-9f87-ab1821521ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4065b3e2-2f57-47ec-9f87-ab1821521ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f2cd9c-2ff0-4ee5-bd31-b4f022c5bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f2cd9c-2ff0-4ee5-bd31-b4f022c5bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22cb2b82-0cbb-4b77-83de-8c1c4336a347', 'volume_name': 'volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f8b657-4431-4326-9e3e-ece4fb489a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f8b657-4431-4326-9e3e-ece4fb489a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ed7fa1-1e34-48ef-b1dd-432e8e1a6633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:43 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Volume 22cb2b82-0cbb-4b77-83de-8c1c4336a347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347', 'volume_size': 1}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-4422778',display_name='tempest-VolumesGetTest-Volume-879013935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cb2b82-0cbb-4b77-83de-8c1c4336a347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:43Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Creating volume 22cb2b82-0cbb-4b77-83de-8c1c4336a347 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:43 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:43 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 1073741824
Sep 12 21:04:43 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ef32c4e7-77f8-4fef-87b7-e8d610fafd05 tempest-GroupsTest-1056394440 None] Update group completed successfully.
Sep 12 21:04:43 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c" returned: 0 in 0.562s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:43 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c
Sep 12 21:04:43 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:44 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 1073741824" returned: 0 in 0.477s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:44 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347
Sep 12 21:04:44 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:44 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-924a39d6-9263-481e-a455-258a54cf462c" returned: 0 in 0.316s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-quobyte-924a39d6-9263-481e-a455-258a54cf462c" released by "delete_volume" :: held 0.942s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Created reservations ['86e03878-b174-4bfa-882f-3513d9ee9b92', 'eeb43a40-74bf-4e1e-9caf-ddd86609a618', 'a0e49fb1-fdef-42f0-9d33-64d0359f567c', '3eb3012b-10df-4bb8-9184-ede5079ff34b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:44 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347" returned: 0 in 0.292s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:44 devstack sudo[100917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:44 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ed7fa1-1e34-48ef-b1dd-432e8e1a6633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead7d50-1964-4a5f-8d49-146ac50ef98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:44 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Volume volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 (22cb2b82-0cbb-4b77-83de-8c1c4336a347): created successfully
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead7d50-1964-4a5f-8d49-146ac50ef98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (f57b415e-e7ed-4cda-ad80-831b71dcc2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2bc65d53-bd05-4a9b-ace7-8b4067dd2359 tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:04:44 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.314s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Deleted volume successfully.
Sep 12 21:04:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-942cfe83-9606-48a2-a792-f4e8640d7369 tempest-ProjectReaderTests-1858981621 None] Lock "cinder-924a39d6-9263-481e-a455-258a54cf462c-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f9074254-6087-496d-aa7a-72975d12da0a tempest-GroupsTest-1056394440 None] Update group completed successfully.
Sep 12 21:04:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-22cb2b82-0cbb-4b77-83de-8c1c4336a347-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Lock "cinder-22cb2b82-0cbb-4b77-83de-8c1c4336a347-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-22cb2b82-0cbb-4b77-83de-8c1c4336a347" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-22cb2b82-0cbb-4b77-83de-8c1c4336a347" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b9d08-540a-4ea6-b4f8-edb3d7cf1743]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:45 devstack sudo[100927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347
Sep 12 21:04:45 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:45 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:46 devstack sudo[100932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347
Sep 12 21:04:46 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:46 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-22cb2b82-0cbb-4b77-83de-8c1c4336a347" returned: 0 in 0.264s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-22cb2b82-0cbb-4b77-83de-8c1c4336a347" released by "delete_volume" :: held 0.697s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Created reservations ['b676a9db-3a3a-4168-aa9e-d006d0c6358c', '3d4f2892-9953-4cad-96f0-80fa0b7889ba', 'bcfaf0d7-bd5a-400a-bafa-f862b7ceff16', 'c9074627-bf8e-4c34-b546-0639d06302c6'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:46 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:46 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:46 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.295s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-14d5d74b-013d-4af5-8e03-38f7af03c946-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87a21564-d1f9-4462-a17a-53401c64a963 tempest-VolumesGetTest-754689783 None] Lock "cinder-22cb2b82-0cbb-4b77-83de-8c1c4336a347-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Acquiring lock "cinder-quobyte-e7de78a7-e712-49d9-b7f3-1010133027c9" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Lock "cinder-14d5d74b-013d-4af5-8e03-38f7af03c946-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Lock "cinder-quobyte-e7de78a7-e712-49d9-b7f3-1010133027c9" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-14d5d74b-013d-4af5-8e03-38f7af03c946" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-14d5d74b-013d-4af5-8e03-38f7af03c946" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc832645-1b21-44ec-ab6e-a62953739ec3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9ef7e2-10ca-4da3-a892-72cfb781324a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:47 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9
Sep 12 21:04:47 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:47 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946
Sep 12 21:04:47 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:47 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9" returned: 0 in 0.386s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:47 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9
Sep 12 21:04:47 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:47 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946" returned: 0 in 0.409s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:47 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946
Sep 12 21:04:47 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:47 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7de78a7-e712-49d9-b7f3-1010133027c9" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Lock "cinder-quobyte-e7de78a7-e712-49d9-b7f3-1010133027c9" released by "delete_volume" :: held 0.744s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Acquiring lock "cinder-quobyte-fec1ef2c-39d0-4165-bc8f-7d652a700fd4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:47 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-14d5d74b-013d-4af5-8e03-38f7af03c946" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-14d5d74b-013d-4af5-8e03-38f7af03c946" released by "delete_volume" :: held 0.723s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Lock "cinder-quobyte-fec1ef2c-39d0-4165-bc8f-7d652a700fd4" acquired by "delete_volume" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[69425299-e7d1-4b60-ba5c-8249d911ac64]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Created reservations ['28fd9d55-288b-4e64-8ff1-ebd98afe1b10', '00c90b08-580d-4e93-82fa-dd29aefd206a', 'e3e20736-a064-4e37-9e68-9cf5b3bb3419', 'ab6558d3-7bcf-40e6-a1dd-54014cf1547e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:47 devstack sudo[100954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4
Sep 12 21:04:47 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:47 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:47 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:48 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4" returned: 0 in 0.415s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:48 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.303s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:48 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4
Sep 12 21:04:48 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-30cf489e-a940-4179-a6ee-adb2fb60ea81 tempest-VolumesGetTest-754689783 None] Lock "cinder-14d5d74b-013d-4af5-8e03-38f7af03c946-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:48 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-fec1ef2c-39d0-4165-bc8f-7d652a700fd4" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Lock "cinder-quobyte-fec1ef2c-39d0-4165-bc8f-7d652a700fd4" released by "delete_volume" :: held 0.732s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Created reservations ['c02c3f3e-2fdd-420b-ba82-278748dbd7c3'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:48 devstack cinder-volume[87624]: WARNING cinder.quota [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2097214955 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2097214955, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:04:48 devstack cinder-volume[87624]: WARNING cinder.quota [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2097214955 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2097214955, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Created reservations ['1f5da0d1-8944-4cd3-9ac3-4f5596c5e284', 'c2628006-6f53-4879-a643-aad0f74aa72d', 'c52bec62-549d-44dd-af61-e4da869db518', 'ef58c4f6-f808-45aa-92c7-e922f9dc623e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Created reservations ['1c8fbdd6-c6ba-42f1-9f14-d01460da02ba', 'e436bbf2-e885-4b06-9007-090031898e41', '1a13bd47-6734-4b7e-ba5d-5204d55b85fe', '983ed0f4-ad34-4068-bc26-be21fd0a3cad'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (d4a055e7-de29-4f8b-bee6-ebebd69d67b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ed9d00-21af-4ef3-bc1e-c1c28e1a06fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ed9d00-21af-4ef3-bc1e-c1c28e1a06fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-612697013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46209ae-60ae-45dd-bd01-ffb184a6c5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:49Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d8393a-aaec-4667-9f38-62ef09fb8850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d8393a-aaec-4667-9f38-62ef09fb8850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a354281-6fc4-49dc-acd4-4bdce7c2d98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a354281-6fc4-49dc-acd4-4bdce7c2d98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'volume_name': 'volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b669a8-0342-4701-9ab3-8f6d5545bcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b669a8-0342-4701-9ab3-8f6d5545bcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9397ef-ea3a-4ca8-8a72-b95795cc98ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:48 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Volume c46209ae-60ae-45dd-bd01-ffb184a6c5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'volume_size': 1}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-612697013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46209ae-60ae-45dd-bd01-ffb184a6c5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:49Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Creating volume c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:04:48 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:48 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 1073741824
Sep 12 21:04:48 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:48 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:48 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:49 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.309s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:04:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1f8312cd-b5a4-4024-9960-f1db7402619d tempest-GroupsTest-1056394440 None] Delete group completed successfully.
Sep 12 21:04:49 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 1073741824" returned: 0 in 0.564s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:49 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:04:49 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:49 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.267s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9397ef-ea3a-4ca8-8a72-b95795cc98ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86933c8-fdd6-400b-ba86-7e0cf0a211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=181,cinder:UPDATE=257,cinder:DELETE=20,cinder:INSERT=57 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:04:49 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Volume volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 (c46209ae-60ae-45dd-bd01-ffb184a6c5f4): created successfully
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86933c8-fdd6-400b-ba86-7e0cf0a211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (d4a055e7-de29-4f8b-bee6-ebebd69d67b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c7e7e4fe-805a-4a7e-97e9-bd43e4f5a005 tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (ae618b8a-4b6e-4632-86ba-40491be50f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7db896-9da6-4da6-840b-6f762ed0b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7db896-9da6-4da6-840b-6f762ed0b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135809823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afbd35e-6bc6-4697-bd22-d6dff177228e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c46209ae-60ae-45dd-bd01-ffb184a6c5f4,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:51Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b33ad9e-c78c-4689-818a-7da17aeab5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b33ad9e-c78c-4689-818a-7da17aeab5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c86d636-2891-4e18-a82a-0e5fec2cccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c86d636-2891-4e18-a82a-0e5fec2cccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2afbd35e-6bc6-4697-bd22-d6dff177228e', 'volume_name': 'volume-2afbd35e-6bc6-4697-bd22-d6dff177228e', 'volume_size': 1, 'source_volid': 'c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'source_volstatus': 'available'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ecb18a-5ee9-4c8c-8b27-c29ea38f4d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ecb18a-5ee9-4c8c-8b27-c29ea38f4d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a96b6c-1b38-4c54-b7b7-2b65379b0a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Volume 2afbd35e-6bc6-4697-bd22-d6dff177228e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2afbd35e-6bc6-4697-bd22-d6dff177228e', 'volume_size': 1, 'source_volid': 'c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'source_volstatus': 'available'}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:51 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Cloning volume c46209ae-60ae-45dd-bd01-ffb184a6c5f4 to volume 2afbd35e-6bc6-4697-bd22-d6dff177228e
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Creating offline snapshot c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe of volume c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89110e7-54de-494b-aba8-f603c094b38b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:51 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:04:51 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:52 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.531s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:52 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe 1G
Sep 12 21:04:52 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:52 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe 1G" returned: 0 in 0.636s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:52 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe
Sep 12 21:04:52 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:53 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" returned: 0 in 0.430s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:53 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe is being set with open permissions: ugo+rw
Sep 12 21:04:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:53 devstack sudo[100999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe
Sep 12 21:04:53 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:53 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:53 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info
Sep 12 21:04:53 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:53 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:53 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info is being set with open permissions: ugo+rw
Sep 12 21:04:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:53 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info
Sep 12 21:04:53 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:54 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.info" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-2afbd35e-6bc6-4697-bd22-d6dff177228e" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-2afbd35e-6bc6-4697-bd22-d6dff177228e" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] snapshot: c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe, volume: 2afbd35e-6bc6-4697-bd22-d6dff177228e,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca5fa2-21aa-4bb6-917e-0e6fe198b020]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:54 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe
Sep 12 21:04:54 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:54 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[49593e5d-5587-4085-9135-e6a0d299db62]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:54 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:04:54 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (43029086-43cd-498e-b0fc-db32c4b862b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652cb42f-5291-4f1b-b566-6ad33fd8b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652cb42f-5291-4f1b-b566-6ad33fd8b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793113092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ebc6ee-ee23-4b50-b452-19c5a8d6e132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:55Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4aafb9-5f24-4b70-a6ed-fb431e7a7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4aafb9-5f24-4b70-a6ed-fb431e7a7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1178b43-4ea6-4ba5-90d9-4b2b9788b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1178b43-4ea6-4ba5-90d9-4b2b9788b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ebc6ee-ee23-4b50-b452-19c5a8d6e132', 'volume_name': 'volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22f58c-1853-4c74-be0a-fafcae718c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22f58c-1853-4c74-be0a-fafcae718c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:04:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060e7f51-610a-47f2-af9f-7509c06734c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:04:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Volume a4ebc6ee-ee23-4b50-b452-19c5a8d6e132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132', 'volume_size': 1}
Sep 12 21:04:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:55 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Sep 12 21:04:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.525s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:04:55 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:04:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:55 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e
Sep 12 21:04:55 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:04:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7f86f02f-8803-4e06-bb78-5c9146460428 tempest-GroupsV320Test-1459332488 None] Group tempest-GroupsV320Test-Group-1535489831: creating
Sep 12 21:04:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7f86f02f-8803-4e06-bb78-5c9146460428 tempest-GroupsV320Test-1459332488 None] Group tempest-GroupsV320Test-Group-1535489831: created successfully
Sep 12 21:04:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7f86f02f-8803-4e06-bb78-5c9146460428 tempest-GroupsV320Test-1459332488 None] Create group completed successfully.
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Created reservations ['92ca6b74-7e25-4e9b-90bb-68b2ae514711'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:04:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:04:59 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:04:59 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:00 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e" returned: 0 in 5.309s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b1f92-ac5a-4d6f-9de6-42530fe516ce]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:00 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.651s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:00 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4289b893-5727-46a0-958b-4749136f7158 tempest-GroupsV320Test-1459332488 None] Delete group completed successfully.
Sep 12 21:05:00 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:05:00 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:01 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.558s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:05:01 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Converted 1024.00 MB image at 192.86 MB/s
Sep 12 21:05:01 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e is being set with open permissions: ugo+rw
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:01 devstack sudo[101101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e
Sep 12 21:05:01 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:01 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e" returned: 0 in 0.261s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-2afbd35e-6bc6-4697-bd22-d6dff177228e" released by "_copy_volume_from_snapshot" :: held 7.143s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Deleting offline snapshot c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe of volume c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] snapshot_file for this snap is: volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de8409-4712-4dd6-9518-f582ce48c2e8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:01 devstack sudo[101104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe
Sep 12 21:05:01 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:01 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223e4e6-f346-4da8-a9a9-ad6f35f083a4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:01 devstack sudo[101113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:05:01 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:02 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.380s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:02 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe
Sep 12 21:05:02 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:02 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" returned: 0 in 0.397s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:02 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe
Sep 12 21:05:02 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:02 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4.c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-c4ae9ecd-53e4-4ef3-a5dc-e522b1dfcebe" released by "_delete_snapshot" :: held 1.519s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.339s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.891s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793113092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ebc6ee-ee23-4b50-b452-19c5a8d6e132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:04:55Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Creating volume a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:02 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:02 devstack sudo[101127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 1073741824
Sep 12 21:05:02 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a96b6c-1b38-4c54-b7b7-2b65379b0a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afbd35e-6bc6-4697-bd22-d6dff177228e', 'volume_size': 1, 'source_volid': 'c46209ae-60ae-45dd-bd01-ffb184a6c5f4', 'source_volstatus': 'available'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e42429-3234-46ef-b5a1-7c20a48c438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:02 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Volume volume-2afbd35e-6bc6-4697-bd22-d6dff177228e (2afbd35e-6bc6-4697-bd22-d6dff177228e): created successfully
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e42429-3234-46ef-b5a1-7c20a48c438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (ae618b8a-4b6e-4632-86ba-40491be50f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c2f3d430-52ea-40b3-b53e-dfabc0461125 tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:05:03 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 1073741824" returned: 0 in 0.488s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:03 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132
Sep 12 21:05:03 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:03 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132" returned: 0 in 0.288s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.293s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060e7f51-610a-47f2-af9f-7509c06734c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f12826-a031-47fd-8762-3976d11529ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ccbe9-7937-4350-92dd-64fc32226225]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Volume volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 (a4ebc6ee-ee23-4b50-b452-19c5a8d6e132): created successfully
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f12826-a031-47fd-8762-3976d11529ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (43029086-43cd-498e-b0fc-db32c4b862b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-016b58ab-2e02-4fa5-8185-9ed248c965d2 tempest-ProjectReaderTests-1332732427 None] Created volume successfully.
Sep 12 21:05:03 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:05:03 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:04 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.469s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-bd11adb7-b990-4e61-9906-8c07177cecef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4488afed-766e-4efe-ac2c-ad2e5be700f5', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:05:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-95482ef2-da7a-4824-a1e1-332f398bd39c req-fa5b9476-77db-4369-8d25-6ffc5cf227f7 tempest-TestStampPattern-212468362 None] attachment_update completed successfully.
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (9af71abd-c40a-4591-8276-200b07e6521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861764e6-8251-4b57-8955-c45e0e8bdd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861764e6-8251-4b57-8955-c45e0e8bdd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-679509418',display_name='tempest-VolumesGetTest-Volume-555510719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:04Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2b4e85-1a2f-4dd3-9176-52e19467e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2b4e85-1a2f-4dd3-9176-52e19467e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347c38ff-4a2c-41ae-8be4-8822b9608683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347c38ff-4a2c-41ae-8be4-8822b9608683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e', 'volume_name': 'volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23fdb7e-3862-4f66-b966-02a43034201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23fdb7e-3862-4f66-b966-02a43034201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5153460-eabb-4e80-871a-7009be41f68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Volume b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e', 'volume_size': 1}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-679509418',display_name='tempest-VolumesGetTest-Volume-555510719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:04Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Creating volume b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:04 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:04 devstack sudo[101322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e 1073741824
Sep 12 21:05:04 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:05 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e 1073741824" returned: 0 in 0.586s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Lock "cinder-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:05 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e
Sep 12 21:05:05 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-quobyte-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f257ae-ff39-43d1-b54f-eb8932f39ce4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:05 devstack sudo[101531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132
Sep 12 21:05:05 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:05 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5153460-eabb-4e80-871a-7009be41f68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9967f2-1996-4cca-a8e0-754258519048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:05 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Volume volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e (b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e): created successfully
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9967f2-1996-4cca-a8e0-754258519048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (9af71abd-c40a-4591-8276-200b07e6521a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0d8cfae8-b77a-4fce-9b36-cc42c8033071 tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:05:05 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132" returned: 0 in 0.460s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:05 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132
Sep 12 21:05:05 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:06 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132" returned: 0 in 0.271s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132" released by "delete_volume" :: held 0.806s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Created reservations ['14051d30-72b5-4cb6-8446-c9abb3699065', '0b2a1a6b-b631-41e3-8091-156657f1f32c', '9b0e8d08-3ad0-45e2-be45-9a12fbcbc15b', 'bdbb3ca3-0a1b-42ab-8bb6-c974062f8d5e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:06 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:06 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:06 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.324s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Deleted volume successfully.
Sep 12 21:05:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-82d8a5e3-d460-458d-8c9c-bbe18eb699de tempest-ProjectReaderTests-1332732427 None] Lock "cinder-a4ebc6ee-ee23-4b50-b452-19c5a8d6e132-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Lock "cinder-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (c60f5216-c39f-4902-a7dd-517015181342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d523b5-d6e2-4161-a165-ffa8fe2093ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d523b5-d6e2-4161-a165-ffa8fe2093ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894170362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d794a93b-f838-4e32-9d22-d3f112922ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:07Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e823aa1-7619-4e21-a2d8-2a59423ec7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e823aa1-7619-4e21-a2d8-2a59423ec7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd1d586-9626-43d5-b290-5936f81616ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd1d586-9626-43d5-b290-5936f81616ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd794a93b-f838-4e32-9d22-d3f112922ffc', 'volume_name': 'volume-d794a93b-f838-4e32-9d22-d3f112922ffc', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f749bf91-ae2f-43a6-9169-2e245ce2b0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f749bf91-ae2f-43a6-9169-2e245ce2b0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173570fb-1c4f-4ff3-9ab2-25e2024b816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Volume d794a93b-f838-4e32-9d22-d3f112922ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d794a93b-f838-4e32-9d22-d3f112922ffc', 'volume_size': 1}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894170362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d794a93b-f838-4e32-9d22-d3f112922ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:07Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Creating volume d794a93b-f838-4e32-9d22-d3f112922ffc {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e" acquired by "delete_volume" :: waited 0.095s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:07 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc 1073741824
Sep 12 21:05:07 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c80a918-83c8-4e10-8343-dd8a9d777691]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:07 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e
Sep 12 21:05:07 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:07 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc 1073741824" returned: 0 in 0.509s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:07 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e" returned: 0 in 0.461s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:07 devstack sudo[101565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e
Sep 12 21:05:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:07 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:07 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc
Sep 12 21:05:07 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:08 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e" released by "delete_volume" :: held 0.911s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:08 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc" returned: 0 in 0.422s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173570fb-1c4f-4ff3-9ab2-25e2024b816a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d794a93b-f838-4e32-9d22-d3f112922ffc', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83990b95-eefe-4807-801b-5a1f282f1434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Volume volume-d794a93b-f838-4e32-9d22-d3f112922ffc (d794a93b-f838-4e32-9d22-d3f112922ffc): created successfully
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83990b95-eefe-4807-801b-5a1f282f1434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (c60f5216-c39f-4902-a7dd-517015181342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e6a57d90-1e9c-44fa-99fd-60f0db598402 tempest-ProjectReaderTests-1332732427 None] Created volume successfully.
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Created reservations ['a0bf9dbd-bbf2-4b5b-b2cc-7bc6650baa5f', '50f9702a-ac8e-4cf7-98ad-c990cb70367f', '0f61447f-0768-44f9-8198-643c983d638f', '960e8be4-5c26-4525-a83d-36bd64383070'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:08 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:08 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:08 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:05:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4c989ab1-17bd-4d08-b39b-18b0ff4f62c1 tempest-VolumesGetTest-754689783 None] Lock "cinder-b9b9b3f6-9072-4b28-b4ef-8c22e4301a8e-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-c97369c0-edb9-4654-ac85-60d6ef657551 req-2e60f0be-8541-4062-9414-c6c057da0a07 tempest-TestStampPattern-212468362 None] Terminate volume connection completed successfully.
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-c97369c0-edb9-4654-ac85-60d6ef657551 req-2e60f0be-8541-4062-9414-c6c057da0a07 tempest-TestStampPattern-212468362 None] Deleting attachment 4488afed-766e-4efe-ac2c-ad2e5be700f5. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-d794a93b-f838-4e32-9d22-d3f112922ffc-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Lock "cinder-d794a93b-f838-4e32-9d22-d3f112922ffc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-quobyte-d794a93b-f838-4e32-9d22-d3f112922ffc" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-d794a93b-f838-4e32-9d22-d3f112922ffc" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b98dfd-4293-41ec-9997-8a6d5e50b621]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-2afbd35e-6bc6-4697-bd22-d6dff177228e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Lock "cinder-2afbd35e-6bc6-4697-bd22-d6dff177228e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:09 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-2afbd35e-6bc6-4697-bd22-d6dff177228e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:09 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-2afbd35e-6bc6-4697-bd22-d6dff177228e" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37e7ae1-6bfe-4250-af8f-fab6579326af]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:09 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e
Sep 12 21:05:09 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:09 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:09 devstack sudo[101619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc
Sep 12 21:05:09 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:09 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e" returned: 0 in 0.441s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:10 devstack sudo[101624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e
Sep 12 21:05:10 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:10 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d794a93b-f838-4e32-9d22-d3f112922ffc" returned: 0 in 0.399s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-d794a93b-f838-4e32-9d22-d3f112922ffc" released by "delete_volume" :: held 0.905s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Creating offline snapshot 155dcc6e-7e51-4b1c-b1ca-8b438767b378 of volume bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7083efba-670a-46f9-bce6-e184dbdefe95]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Created reservations ['f11fae2c-96a4-4cae-9db1-76062c18f5d7', 'e30d4ef3-f1f8-4472-b5b7-eb42d8d1875d', '9418ae97-216c-4e28-ba8b-9a4e5b3705a3', '8ceda084-99ab-499e-893a-f21da5ea7496'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:10 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2afbd35e-6bc6-4697-bd22-d6dff177228e" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-2afbd35e-6bc6-4697-bd22-d6dff177228e" released by "delete_volume" :: held 0.812s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:10 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:05:10 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Created reservations ['94464f18-2223-4474-958c-e3646367bb59', '5668ab4a-5e24-490c-9078-aae807161abe', 'c3ebc3b7-03ed-4249-ad3a-97106a6c8e6c', '8ccb4773-df8a-40d6-98b2-22e02e448870'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:10 devstack sudo[101630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:10 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:10 devstack sudo[101632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:10 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:10 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:10 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.372s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.531s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:10 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-c46209ae-60ae-45dd-bd01-ffb184a6c5f4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:10 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 1G
Sep 12 21:05:10 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Deleted volume successfully.
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.317s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f4c485b-8f7a-4bb7-a65e-45959aed3cbc tempest-ProjectReaderTests-1332732427 None] Lock "cinder-d794a93b-f838-4e32-9d22-d3f112922ffc-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Lock "cinder-c46209ae-60ae-45dd-bd01-ffb184a6c5f4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cdd2ec1a-06eb-4c05-a946-7bcc83e272ee tempest-VolumesGetTest-754689783 None] Lock "cinder-2afbd35e-6bc6-4697-bd22-d6dff177228e-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf1bb3-0189-44b7-8580-1d6ed43a955f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:11 devstack sudo[101641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:05:11 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:11 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 1G" returned: 0 in 0.494s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd11adb7-b990-4e61-9906-8c07177cecef -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:11 devstack sudo[101647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd11adb7-b990-4e61-9906-8c07177cecef -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378
Sep 12 21:05:11 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:11 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.412s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:11 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4
Sep 12 21:05:11 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:11 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd11adb7-b990-4e61-9906-8c07177cecef -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:11 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 is being set with open permissions: ugo+rw
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:11 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378
Sep 12 21:05:11 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:11 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" returned: 0 in 0.316s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-c46209ae-60ae-45dd-bd01-ffb184a6c5f4" released by "delete_volume" :: held 0.805s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Created reservations ['4e9effea-a158-4320-88cc-fc88f1174ce7', '8d8b67fc-98e5-435e-ad5f-7a0203564d55', '8c92d376-ce64-4432-aa0e-d00193bd8cc3', '20281195-f480-496f-8122-ae8053967a90'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:11 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378" returned: 0 in 0.311s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:11 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:11 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:12 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info
Sep 12 21:05:12 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (a07318ed-fa0b-4cb8-bdf5-1e5b1fbf640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081065a8-bb04-4315-ae89-0cb14bd77bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081065a8-bb04-4315-ae89-0cb14bd77bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277018450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a99fa4-5740-4a80-a983-03f51c7371ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:12Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbde966-3224-4129-af6c-51f7424aee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbde966-3224-4129-af6c-51f7424aee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189a6eb8-7895-4009-bfb5-90e2fed9f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189a6eb8-7895-4009-bfb5-90e2fed9f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a99fa4-5740-4a80-a983-03f51c7371ce', 'volume_name': 'volume-c8a99fa4-5740-4a80-a983-03f51c7371ce', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da762d9a-a3ec-497c-8abf-2f4cb6bb0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da762d9a-a3ec-497c-8abf-2f4cb6bb0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498466d-dc1e-44e6-b446-bf8767532dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:12 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Volume c8a99fa4-5740-4a80-a983-03f51c7371ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a99fa4-5740-4a80-a983-03f51c7371ce', 'volume_size': 1}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:12 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.402s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5737edc8-b716-47e0-8131-c400e4969a19 tempest-VolumesGetTest-754689783 None] Lock "cinder-c46209ae-60ae-45dd-bd01-ffb184a6c5f4-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:12 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info" returned: 0 in 0.380s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:12 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info is being set with open permissions: ugo+rw
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:12 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info
Sep 12 21:05:12 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:12 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.info" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277018450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a99fa4-5740-4a80-a983-03f51c7371ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:12Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Creating volume c8a99fa4-5740-4a80-a983-03f51c7371ce {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:12 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:12 devstack sudo[101672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce 1073741824
Sep 12 21:05:12 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-eecb1db2-27b0-42db-ab23-ebdeff199d32 tempest-TestStampPattern-212468362 None] Create snapshot completed successfully
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (63e4dbf4-f21d-4f52-a0e3-9e55b7c1caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c33462-d84b-4780-b5c3-e3336f719bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c33462-d84b-4780-b5c3-e3336f719bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-746302790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b64712d-c99c-4fb5-974d-1e00284ebe56,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:13Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d71183-c972-4dd3-966b-5e4285fa5980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d71183-c972-4dd3-966b-5e4285fa5980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a450b710-6ea6-4aa4-818d-dd5efb8d730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:05:13 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce 1073741824" returned: 0 in 0.538s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:13 devstack sudo[101678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce
Sep 12 21:05:13 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a450b710-6ea6-4aa4-818d-dd5efb8d730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b64712d-c99c-4fb5-974d-1e00284ebe56', 'volume_name': 'volume-4b64712d-c99c-4fb5-974d-1e00284ebe56', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d8db80>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ede0a5-b4a5-4c39-bb21-a1cc5566a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ede0a5-b4a5-4c39-bb21-a1cc5566a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:13 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8492cce-f692-4256-8024-01fd5e8680a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Volume 4b64712d-c99c-4fb5-974d-1e00284ebe56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b64712d-c99c-4fb5-974d-1e00284ebe56', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d8db80>}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Trying to clone 4b64712d-c99c-4fb5-974d-1e00284ebe56 from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce" returned: 0 in 0.316s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498466d-dc1e-44e6-b446-bf8767532dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a99fa4-5740-4a80-a983-03f51c7371ce', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36ee704-2376-4fc2-a34a-765f4d4133a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Volume volume-c8a99fa4-5740-4a80-a983-03f51c7371ce (c8a99fa4-5740-4a80-a983-03f51c7371ce): created successfully
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36ee704-2376-4fc2-a34a-765f4d4133a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (a07318ed-fa0b-4cb8-bdf5-1e5b1fbf640c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-02220a1e-cbff-4025-b5f2-cb2d8d7e2309 tempest-ProjectReaderTests-1332732427 None] Created volume successfully.
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:05:14 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Image download 20.69 MB at 20.69 MB/s
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6932d9d-9f07-4fa0-a318-2ea205b1da67]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:14 devstack sudo[101682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD
Sep 12 21:05:14 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-c8a99fa4-5740-4a80-a983-03f51c7371ce-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Lock "cinder-c8a99fa4-5740-4a80-a983-03f51c7371ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-quobyte-c8a99fa4-5740-4a80-a983-03f51c7371ce" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-c8a99fa4-5740-4a80-a983-03f51c7371ce" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[41903968-b696-4fa6-bb43-df699b99688a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:14 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce
Sep 12 21:05:14 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:14 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 is fetched for user 0964f3a3467649d8b238a5f2f914ab7c. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccea9c0-d63b-43ad-b63d-7dd5d48f8f8a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:14 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD
Sep 12 21:05:14 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:14 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce" returned: 0 in 0.459s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:14 devstack sudo[101695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce
Sep 12 21:05:14 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:15 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-746302790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b64712d-c99c-4fb5-974d-1e00284ebe56,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:13Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Creating volume 4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:15 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:15 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 1073741824
Sep 12 21:05:15 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:15 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c8a99fa4-5740-4a80-a983-03f51c7371ce" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-c8a99fa4-5740-4a80-a983-03f51c7371ce" released by "delete_volume" :: held 0.896s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Created reservations ['6bfdb645-825f-4c34-92f1-4b9dc0b40dcc', '506bd5bd-7fda-46a8-8110-64156038bc76', '2d4a9b83-00c0-4cce-af0c-1824c573935a', 'e27d8057-a15d-4d53-ba71-ec3a9a73b64c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:15 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:15 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:15 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 1073741824" returned: 0 in 0.587s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:15 devstack sudo[101720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:15 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:15 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.369s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Deleted volume successfully.
Sep 12 21:05:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ebfb66f-b106-4ad7-a4f0-8c9cbd6e5b84 tempest-ProjectReaderTests-1332732427 None] Lock "cinder-c8a99fa4-5740-4a80-a983-03f51c7371ce-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:16 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 0 in 0.410s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (0f0bc1eb-64ed-40b4-a32f-1ccd6f5e21fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8ac633-4c20-48b9-aded-baae6275d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8ac633-4c20-48b9-aded-baae6275d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71148007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd2d4ff-ec46-41a5-803f-0418f7771dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:16Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73542f1-734d-4254-aea2-72fb44ba86dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73542f1-734d-4254-aea2-72fb44ba86dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce93060-e58a-42f2-9301-db5c8199336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce93060-e58a-42f2-9301-db5c8199336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd2d4ff-ec46-41a5-803f-0418f7771dd8', 'volume_name': 'volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1384d0ab-75eb-4cb4-bcc8-d0ce63dc089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1384d0ab-75eb-4cb4-bcc8-d0ce63dc089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38479e89-b2da-40b8-877d-d1893c13991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Volume 8bd2d4ff-ec46-41a5-803f-0418f7771dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8', 'volume_size': 1}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71148007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd2d4ff-ec46-41a5-803f-0418f7771dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350d5605b1bc4653a12e4012d694a149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:16Z,use_quota=True,user_id='df5666d4b8a142c4bd6671699d87ef29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Creating volume 8bd2d4ff-ec46-41a5-803f-0418f7771dd8 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:16 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Attempting download of 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume 4b64712d-c99c-4fb5-974d-1e00284ebe56. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:05:16 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 1073741824
Sep 12 21:05:16 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Flow 'volume_create_manager' (754d621b-68e2-45b3-a5fb-bebc6f2d45ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc16db98-c6b1-439a-88f0-8ac20c641958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc16db98-c6b1-439a-88f0-8ac20c641958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-222229419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0daf249-846a-4b9a-87d4-7e30f7d40268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c36e694ec4ea6931a4d0d90e886ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:16Z,use_quota=True,user_id='4a65b39121cb43af9aa06191e730d18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fcb3f2-6f8d-4763-be5c-7de6203f04a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fcb3f2-6f8d-4763-be5c-7de6203f04a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616bd1e6-035f-4926-9b13-674730b93491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616bd1e6-035f-4926-9b13-674730b93491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0daf249-846a-4b9a-87d4-7e30f7d40268', 'volume_name': 'volume-a0daf249-846a-4b9a-87d4-7e30f7d40268', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5647e674-8982-4628-a0a3-813281ff098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5647e674-8982-4628-a0a3-813281ff098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c79e0f-b3f0-452b-9970-b6e60b981aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Volume a0daf249-846a-4b9a-87d4-7e30f7d40268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0daf249-846a-4b9a-87d4-7e30f7d40268', 'volume_size': 1}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[324f643f-68cc-40bc-88b9-b604d9d2a846]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:16 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8
Sep 12 21:05:16 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:16 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 1073741824" returned: 0 in 0.478s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:16 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:16 devstack sudo[101758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8
Sep 12 21:05:16 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:17 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8
Sep 12 21:05:17 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:17 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8" returned: 0 in 0.296s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-222229419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0daf249-846a-4b9a-87d4-7e30f7d40268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='618c36e694ec4ea6931a4d0d90e886ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:16Z,use_quota=True,user_id='4a65b39121cb43af9aa06191e730d18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Creating volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:17 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:17 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8" returned: 1 in 0.362s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1li10ck8' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38479e89-b2da-40b8-877d-d1893c13991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864719b8-787e-4f6d-86fb-c67ca045e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:17 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 1073741824
Sep 12 21:05:17 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ff386-5f36-40a6-9006-fa12c66e2ea2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Volume volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 (8bd2d4ff-ec46-41a5-803f-0418f7771dd8): created successfully
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864719b8-787e-4f6d-86fb-c67ca045e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Flow 'volume_create_manager' (0f0bc1eb-64ed-40b4-a32f-1ccd6f5e21fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f52a8bf9-b353-4fc9-9b44-9a588eb121d0 tempest-ProjectReaderTests-1332732427 None] Created volume successfully.
Sep 12 21:05:17 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD
Sep 12 21:05:17 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:17 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 was qcow2, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:17 devstack sudo[101775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:17 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:17 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 1073741824" returned: 0 in 0.554s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:17 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268
Sep 12 21:05:17 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:18 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268" returned: 0 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c79e0f-b3f0-452b-9970-b6e60b981aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0daf249-846a-4b9a-87d4-7e30f7d40268', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ad481d-35ff-4295-96ba-f390b09cfbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:18 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Volume volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 (a0daf249-846a-4b9a-87d4-7e30f7d40268): created successfully
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ad481d-35ff-4295-96ba-f390b09cfbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Flow 'volume_create_manager' (754d621b-68e2-45b3-a5fb-bebc6f2d45ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-166d2c50-31dc-468d-ac08-22acae8ce1ce tempest-SnapshotsActionsTest-133492461 None] Created volume successfully.
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-8bd2d4ff-ec46-41a5-803f-0418f7771dd8-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Lock "cinder-8bd2d4ff-ec46-41a5-803f-0418f7771dd8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Acquiring lock "cinder-quobyte-8bd2d4ff-ec46-41a5-803f-0418f7771dd8" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-8bd2d4ff-ec46-41a5-803f-0418f7771dd8" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[41229f97-275e-4a6e-9b44-8671883c5868]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:18 devstack sudo[101789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8
Sep 12 21:05:18 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Creating offline snapshot cf6231e0-d700-4b89-aa33-8989810e2246 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[109e75df-e90d-447e-af9f-af76c9337803]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:19 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8" returned: 0 in 0.507s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:19 devstack sudo[101802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8
Sep 12 21:05:19 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:19 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268
Sep 12 21:05:19 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:19 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-8bd2d4ff-ec46-41a5-803f-0418f7771dd8" returned: 0 in 0.305s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Lock "cinder-quobyte-8bd2d4ff-ec46-41a5-803f-0418f7771dd8" released by "delete_volume" :: held 0.902s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Created reservations ['5bf6f073-41bf-4dc9-ba3a-79f22b4d9e3e', '32f75362-2119-436c-b6b0-8adc65b16eb9', 'fc854e8e-c697-48f5-8e39-7da47eb7a7f8', '5e2f3a0d-293a-4c43-b277-2f5345cf5178'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:19 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268" returned: 0 in 0.583s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:19 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 1G
Sep 12 21:05:19 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:19 devstack sudo[101811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:19 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:19 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 0 in 2.177s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_1yrq534ydevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:05:19 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Converted 112.00 MB image at 51.42 MB/s
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:19 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 1G
Sep 12 21:05:19 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:19 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:19 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Deleted volume successfully.
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-66883c1c-e252-48c1-b50e-438fc3ee7e6d tempest-ProjectReaderTests-1332732427 None] Lock "cinder-8bd2d4ff-ec46-41a5-803f-0418f7771dd8-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:20 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 1G" returned: 0 in 0.682s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:20 devstack sudo[101821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:20 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:20 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 1G" returned: 0 in 0.391s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e81946-8faa-4ad3-b1a5-a42e782d3dff]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:20 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:20 devstack sudo[101824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:20 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 is being set with open permissions: ugo+rw
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:20 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:20 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:20 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:20 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 0 in 0.487s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:20 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:20 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info
Sep 12 21:05:20 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:20 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:20 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:21 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info" returned: 0 in 0.375s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:21 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info is being set with open permissions: ugo+rw
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:21 devstack sudo[101843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info
Sep 12 21:05:21 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:21 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 1 in 0.510s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Downloaded image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume 4b64712d-c99c-4fb5-974d-1e00284ebe56 successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 for user 0964f3a3467649d8b238a5f2f914ab7c is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Marking volume 4b64712d-c99c-4fb5-974d-1e00284ebe56 as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Copying metadata from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 to 4b64712d-c99c-4fb5-974d-1e00284ebe56. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Creating volume glance metadata for volume 4b64712d-c99c-4fb5-974d-1e00284ebe56 backed by image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8492cce-f692-4256-8024-01fd5e8680a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b64712d-c99c-4fb5-974d-1e00284ebe56', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d8db80>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a93b876-4447-494b-8530-c63f383b7392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:21 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Volume volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 (4b64712d-c99c-4fb5-974d-1e00284ebe56): created successfully
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a93b876-4447-494b-8530-c63f383b7392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (63e4dbf4-f21d-4f52-a0e3-9e55b7c1caa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1deb0dd9-d2bd-4fe6-8c0e-4fe65e661f73 tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:05:21 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.info" returned: 0 in 0.341s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.797s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e7e43421-a425-4393-aaf7-eaac55369a05 tempest-SnapshotsActionsTest-133492461 None] Create snapshot completed successfully
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:INSERT=56,cinder:UPDATE=232,cinder:SELECT=182,cinder:DELETE=21 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Flow 'volume_create_manager' (08c6653f-2349-4a2c-bb86-ddb8a0699ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce48027-dbbe-4fa9-a0b4-867c4c8bcb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce48027-dbbe-4fa9-a0b4-867c4c8bcb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-534821818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b212021-b712-4589-bb5f-cd556a0739ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a79d1ccb4a4dbd889a0037edcbf10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=155dcc6e-7e51-4b1c-b1ca-8b438767b378,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:22Z,use_quota=True,user_id='6aeabbf1580e46d0b7155c8e0e7af1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de753ca-22b3-435c-ad8e-9e21c56c7975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de753ca-22b3-435c-ad8e-9e21c56c7975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7637715c-177b-4685-88dc-f36af1746c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7637715c-177b-4685-88dc-f36af1746c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b212021-b712-4589-bb5f-cd556a0739ee', 'volume_name': 'volume-4b212021-b712-4589-bb5f-cd556a0739ee', 'volume_size': 1, 'snapshot_id': '155dcc6e-7e51-4b1c-b1ca-8b438767b378'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916870b1-2de0-4526-8407-a299415f1298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916870b1-2de0-4526-8407-a299415f1298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7041e9fc-de3c-4f34-b1b0-9148ee76dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:21 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Volume 4b212021-b712-4589-bb5f-cd556a0739ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b212021-b712-4589-bb5f-cd556a0739ee', 'volume_size': 1, 'snapshot_id': '155dcc6e-7e51-4b1c-b1ca-8b438767b378'}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-quobyte-155dcc6e-7e51-4b1c-b1ca-8b438767b378-4b212021-b712-4589-bb5f-cd556a0739ee" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-155dcc6e-7e51-4b1c-b1ca-8b438767b378-4b212021-b712-4589-bb5f-cd556a0739ee" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Creating volume 4b212021-b712-4589-bb5f-cd556a0739ee from snapshot 155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-quobyte-4b212021-b712-4589-bb5f-cd556a0739ee" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-4b212021-b712-4589-bb5f-cd556a0739ee" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] snapshot: 155dcc6e-7e51-4b1c-b1ca-8b438767b378, volume: 4b212021-b712-4589-bb5f-cd556a0739ee,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f506b9-6605-4f40-9c5d-82b7127474ce]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:22 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378
Sep 12 21:05:22 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (b3d415ef-04d2-47e1-8077-c008dd868017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707c8ddc-cfbc-4a22-b641-97d62e9f10a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:22 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378" returned: 0 in 0.536s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd11adb7-b990-4e61-9906-8c07177cecef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707c8ddc-cfbc-4a22-b641-97d62e9f10a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1841889152',display_name='tempest-VolumesGetTest-Volume-1163998383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b323369-f775-4682-bb12-c0513d1f2229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:23Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1ece1e-7739-4ae5-91c7-3038051ba19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1ece1e-7739-4ae5-91c7-3038051ba19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1fbc26-a1be-4a20-8d53-a81557148eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1fbc26-a1be-4a20-8d53-a81557148eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b323369-f775-4682-bb12-c0513d1f2229', 'volume_name': 'volume-1b323369-f775-4682-bb12-c0513d1f2229', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c68ba6-8794-4d02-a851-bac8d968da64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c68ba6-8794-4d02-a851-bac8d968da64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3c1d25-62f6-405c-8ab8-42dbb3e6cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Volume 1b323369-f775-4682-bb12-c0513d1f2229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b323369-f775-4682-bb12-c0513d1f2229', 'volume_size': 1}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a04a5a1-3b53-4c0a-bf9c-f8e872282b26]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:23 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:05:23 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:23 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.473s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:23 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:05:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:23 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee
Sep 12 21:05:23 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:29 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee" returned: 0 in 5.905s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4393b-5eb6-4b0c-b4ae-818fae57ca40]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:29 devstack sudo[101875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:05:29 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:29 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.603s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:29 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:05:29 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Converted 1024.00 MB image at 173.34 MB/s
Sep 12 21:05:29 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee is being set with open permissions: ugo+rw
Sep 12 21:05:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:29 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee
Sep 12 21:05:29 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:30 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee" returned: 0 in 0.279s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-4b212021-b712-4589-bb5f-cd556a0739ee" released by "_copy_volume_from_snapshot" :: held 8.020s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-155dcc6e-7e51-4b1c-b1ca-8b438767b378-4b212021-b712-4589-bb5f-cd556a0739ee" released by "_create_volume_from_snapshot" :: held 8.089s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.128s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.307s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:05:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1841889152',display_name='tempest-VolumesGetTest-Volume-1163998383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b323369-f775-4682-bb12-c0513d1f2229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62e102ee354635b083e081980c56d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:05:23Z,use_quota=True,user_id='0964f3a3467649d8b238a5f2f914ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Creating volume 1b323369-f775-4682-bb12-c0513d1f2229 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:05:30 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:30 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229 1073741824
Sep 12 21:05:30 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7041e9fc-de3c-4f34-b1b0-9148ee76dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b212021-b712-4589-bb5f-cd556a0739ee', 'volume_size': 1, 'snapshot_id': '155dcc6e-7e51-4b1c-b1ca-8b438767b378'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abdcaf5-152e-4fcc-89d6-f51c299fb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:30 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Volume volume-4b212021-b712-4589-bb5f-cd556a0739ee (4b212021-b712-4589-bb5f-cd556a0739ee): created successfully
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abdcaf5-152e-4fcc-89d6-f51c299fb04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Flow 'volume_create_manager' (08c6653f-2349-4a2c-bb86-ddb8a0699ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-03f54bc5-fcf8-4a85-a6af-f4229932efea tempest-TestStampPattern-212468362 None] Created volume successfully.
Sep 12 21:05:30 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229 1073741824" returned: 0 in 0.714s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:30 devstack sudo[101931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229
Sep 12 21:05:30 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:31 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229" returned: 0 in 0.296s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.175s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3c1d25-62f6-405c-8ab8-42dbb3e6cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b323369-f775-4682-bb12-c0513d1f2229', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d683dea3-da23-43d6-93d2-93aaa3d3bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Creating offline snapshot 2e92af98-6891-4bed-ba1a-e93bb78e914b of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:05:31 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Volume volume-1b323369-f775-4682-bb12-c0513d1f2229 (1b323369-f775-4682-bb12-c0513d1f2229): created successfully
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d683dea3-da23-43d6-93d2-93aaa3d3bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Flow 'volume_create_manager' (b3d415ef-04d2-47e1-8077-c008dd868017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f0730b-d308-4ea7-974c-b278d1bdefac]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d377bcd9-b216-4f69-9650-9794ee4abddf tempest-VolumesGetTest-754689783 None] Created volume successfully.
Sep 12 21:05:31 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:31 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:31 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.426s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-1b323369-f775-4682-bb12-c0513d1f2229-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Lock "cinder-1b323369-f775-4682-bb12-c0513d1f2229-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:31 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b 1G
Sep 12 21:05:31 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-1b323369-f775-4682-bb12-c0513d1f2229" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-1b323369-f775-4682-bb12-c0513d1f2229" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ab70f2-97ad-44de-b4f0-679012e25242]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:32 devstack sudo[101967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229
Sep 12 21:05:32 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:32 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229" returned: 0 in 0.427s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:32 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b 1G" returned: 0 in 0.632s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:32 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229
Sep 12 21:05:32 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:32 devstack sudo[101979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b
Sep 12 21:05:32 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:32 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1b323369-f775-4682-bb12-c0513d1f2229" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-1b323369-f775-4682-bb12-c0513d1f2229" released by "delete_volume" :: held 0.808s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:32 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b" returned: 0 in 0.349s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:32 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b is being set with open permissions: ugo+rw
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:32 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Created reservations ['9480fc48-b1e5-4e64-bb95-df6fbea6f6b8', '97a81f67-3e45-4e54-903a-c6cf4149e1e4', 'b5b522d1-990e-4fe4-a798-c4e51efa311f', '0f6e36c2-2a12-42e4-83c4-0869626439c5'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:32 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:32 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:32 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:33 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-4b64712d-c99c-4fb5-974d-1e00284ebe56-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Lock "cinder-4b64712d-c99c-4fb5-974d-1e00284ebe56-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:33 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3ac22e9d-cb64-4f44-9200-855f34f1a14c tempest-SnapshotsActionsTest-133492461 None] Create snapshot completed successfully
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Acquiring lock "cinder-quobyte-4b64712d-c99c-4fb5-974d-1e00284ebe56" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:33 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.532s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-4b64712d-c99c-4fb5-974d-1e00284ebe56" acquired by "delete_volume" :: waited 0.059s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:33 devstack sudo[101992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:33 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:33 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92f48a39-a7c4-42ff-9079-398766c8069a tempest-VolumesGetTest-754689783 None] Lock "cinder-1b323369-f775-4682-bb12-c0513d1f2229-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b004bb-929b-4e29-95b6-743b453d8da9]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:33 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:33 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:33 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.289s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-2e92af98-6891-4bed-ba1a-e93bb78e914b-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-2e92af98-6891-4bed-ba1a-e93bb78e914b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-2e92af98-6891-4bed-ba1a-e93bb78e914b" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-2e92af98-6891-4bed-ba1a-e93bb78e914b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Deleting offline snapshot 2e92af98-6891-4bed-ba1a-e93bb78e914b of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] snapshot_file for this snap is: volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb1fd30-7f01-4246-aff9-e0ccb08fa6b9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:34 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 0 in 0.587s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:34 devstack sudo[101999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b
Sep 12 21:05:34 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:34 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:34 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:34 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b" returned: 0 in 0.457s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:34 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 1 in 0.463s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac169005-a995-4121-84db-73daa49f3182]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:34 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56
Sep 12 21:05:34 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:34 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:34 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:34 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b64712d-c99c-4fb5-974d-1e00284ebe56" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Lock "cinder-quobyte-4b64712d-c99c-4fb5-974d-1e00284ebe56" released by "delete_volume" :: held 1.525s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Created reservations ['3426862d-8aa1-4738-853e-0ffa24736969', '320d674c-f6f2-44d9-bed2-79a778391be1', 'dc5eb516-a1ce-4c96-9d36-cb0209f5a95c', '5e2973fb-e1c1-4cc8-993f-ce90f1d5ae02'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:35 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:35 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.627s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:35 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:35 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b
Sep 12 21:05:35 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:35 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.283s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Deleted volume successfully.
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b0545af8-4afb-49dd-b287-95e671e7523a tempest-VolumesGetTest-754689783 None] Lock "cinder-4b64712d-c99c-4fb5-974d-1e00284ebe56-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:35 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b" returned: 0 in 0.536s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:35 devstack sudo[102027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b
Sep 12 21:05:35 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:36 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.2e92af98-6891-4bed-ba1a-e93bb78e914b" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-2e92af98-6891-4bed-ba1a-e93bb78e914b" released by "_delete_snapshot" :: held 2.201s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" released by "delete_snapshot" :: held 2.240s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:36 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Created reservations ['f168514d-3c54-4a33-8b35-789256c24583', '79c179ab-f70b-4caa-866c-395e87487272', 'dbc51299-5328-42df-9772-21529aeaf2c5', '715bfd2a-9af4-4fbe-bc2a-08f74c525e36'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Delete snapshot completed successfully.
Sep 12 21:05:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-19bd71eb-e37f-4a06-8a67-d1b8b7232cf9 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-2e92af98-6891-4bed-ba1a-e93bb78e914b-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Creating offline snapshot e1edf3a4-abb5-4fe1-8c11-83b5148577d9 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:05:37 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea8b77-e565-4886-a49a-21af6b0ef192]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:37 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:37 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:38 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.429s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:38 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 1G
Sep 12 21:05:38 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:38 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 1G" returned: 0 in 0.480s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:38 devstack sudo[102044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9
Sep 12 21:05:38 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:38 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:38 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 is being set with open permissions: ugo+rw
Sep 12 21:05:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:38 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9
Sep 12 21:05:38 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:39 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9" returned: 0 in 0.313s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.660s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e08d4043-6066-48bf-bfe8-c82c2d694d93 tempest-SnapshotsActionsTest-133492461 None] Create snapshot completed successfully
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-e1edf3a4-abb5-4fe1-8c11-83b5148577d9-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-e1edf3a4-abb5-4fe1-8c11-83b5148577d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-e1edf3a4-abb5-4fe1-8c11-83b5148577d9" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-e1edf3a4-abb5-4fe1-8c11-83b5148577d9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Deleting offline snapshot e1edf3a4-abb5-4fe1-8c11-83b5148577d9 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] snapshot_file for this snap is: volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[83239587-a44c-461f-af41-07628aa7f804]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:40 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9
Sep 12 21:05:40 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:40 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c28ed7-a90e-43d8-bcf5-438d1f5e802b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:40 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:40 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:40 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.425s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:40 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9
Sep 12 21:05:40 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:41 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9" returned: 0 in 0.464s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:41 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9
Sep 12 21:05:41 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:41 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e1edf3a4-abb5-4fe1-8c11-83b5148577d9" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-e1edf3a4-abb5-4fe1-8c11-83b5148577d9" released by "_delete_snapshot" :: held 1.721s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" released by "delete_snapshot" :: held 1.747s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Created reservations ['6a44f438-c953-471a-ba9f-eec7641f2a8e', 'b13cc58a-5d53-4fab-bf87-bdb31070a300', 'b0cf8c52-29e1-4237-a76d-c347940968db', '9c959168-f4fa-4de5-8e2d-475e86057a39'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Delete snapshot completed successfully.
Sep 12 21:05:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c0166016-2649-4698-a7d2-a10eefa7cc78 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-e1edf3a4-abb5-4fe1-8c11-83b5148577d9-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Creating offline snapshot 4b5dc827-47e4-4415-a922-edea7d050814 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[287aebd8-d4c5-4143-a6e3-74ad766ee9a9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:42 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:42 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:42 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.408s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:42 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 1G
Sep 12 21:05:42 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:43 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 1G" returned: 0 in 0.580s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:43 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814
Sep 12 21:05:43 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:43 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814" returned: 0 in 0.341s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:43 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 is being set with open permissions: ugo+rw
Sep 12 21:05:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:43 devstack sudo[102090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814
Sep 12 21:05:43 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:44 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814" returned: 0 in 0.267s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.732s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-870bc4f9-5fb7-409a-9902-c8830b15742c tempest-SnapshotsActionsTest-133492461 None] Create snapshot completed successfully
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-4b5dc827-47e4-4415-a922-edea7d050814-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-4b5dc827-47e4-4415-a922-edea7d050814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-4b5dc827-47e4-4415-a922-edea7d050814" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-4b5dc827-47e4-4415-a922-edea7d050814" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Deleting offline snapshot 4b5dc827-47e4-4415-a922-edea7d050814 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] snapshot_file for this snap is: volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b4e37-f1a2-497f-a718-7e8615bfa236]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:44 devstack sudo[102098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814
Sep 12 21:05:44 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:45 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814" returned: 0 in 0.417s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b12c0-abc8-4257-841a-77e318ab387b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:45 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:45 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:45 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:45 devstack sudo[102109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814
Sep 12 21:05:45 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:45 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:46 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814
Sep 12 21:05:46 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:46 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.4b5dc827-47e4-4415-a922-edea7d050814" returned: 0 in 0.264s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-4b5dc827-47e4-4415-a922-edea7d050814" released by "_delete_snapshot" :: held 1.575s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" released by "delete_snapshot" :: held 1.603s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Created reservations ['6d255159-92b6-4ffb-9023-b8fc19685bee', 'ca570b27-f166-46d2-b3ed-c2340ca33e14', '1d9bfc09-a093-42ab-be83-21f65353d89a', 'c70db596-46ca-4962-8f8e-0a39cea42376'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Delete snapshot completed successfully.
Sep 12 21:05:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-104982ab-10e9-4904-ba77-f0c285aedf5c tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-4b5dc827-47e4-4415-a922-edea7d050814-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Creating offline snapshot e2635d40-2357-492a-bca7-1d81c3d7ca15 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4f1b39-ad67-42df-be88-7edcd991a47f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:47 devstack sudo[102117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:47 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:47 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.374s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:47 devstack sudo[102122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 1G
Sep 12 21:05:47 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:48 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 1G" returned: 0 in 0.448s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:48 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15
Sep 12 21:05:48 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:48 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15" returned: 0 in 0.305s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:48 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 is being set with open permissions: ugo+rw
Sep 12 21:05:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:48 devstack sudo[102133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15
Sep 12 21:05:48 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:48 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15" returned: 0 in 0.259s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.491s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-15133126-f170-4c82-a2e5-865be0516a56 tempest-SnapshotsActionsTest-133492461 None] Create snapshot completed successfully
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-e2635d40-2357-492a-bca7-1d81c3d7ca15-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-e2635d40-2357-492a-bca7-1d81c3d7ca15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Acquiring lock "cinder-quobyte-e2635d40-2357-492a-bca7-1d81c3d7ca15" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-e2635d40-2357-492a-bca7-1d81c3d7ca15" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Deleting offline snapshot e2635d40-2357-492a-bca7-1d81c3d7ca15 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] snapshot_file for this snap is: volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b108fa-dae1-470c-b615-26ddba453e6c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:49 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15
Sep 12 21:05:49 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:49 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4149d-0047-4bf4-9083-4e21adc19b97]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:50 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:50 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:50 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:50 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15
Sep 12 21:05:50 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:50 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15" returned: 0 in 0.416s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:50 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15
Sep 12 21:05:50 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:50 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.e2635d40-2357-492a-bca7-1d81c3d7ca15" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-e2635d40-2357-492a-bca7-1d81c3d7ca15" released by "_delete_snapshot" :: held 1.528s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" released by "delete_snapshot" :: held 1.554s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:51 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=119,cinder:UPDATE=135,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:05:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Created reservations ['346fff3f-ddb4-446e-ace8-6120c497a86d', 'acb2c2d7-a1a6-4c62-a2ea-286d5ec2c81a', '0a7b0eb4-77fc-42d4-8897-895d461d345d', '05a0793f-0bc7-4c49-a04c-3197fd07916d'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Delete snapshot completed successfully.
Sep 12 21:05:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-365dfccd-ae9b-469f-91ed-0e35f3cfd869 tempest-SnapshotsActionsTest-632231759 None] Lock "cinder-e2635d40-2357-492a-bca7-1d81c3d7ca15-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "cinder-cf6231e0-d700-4b89-aa33-8989810e2246-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-cf6231e0-d700-4b89-aa33-8989810e2246-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "cinder-quobyte-cf6231e0-d700-4b89-aa33-8989810e2246" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-quobyte-cf6231e0-d700-4b89-aa33-8989810e2246" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Deleting offline snapshot cf6231e0-d700-4b89-aa33-8989810e2246 of volume a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] snapshot_file for this snap is: volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf07158-8ed0-41a8-8a8e-90d43b8959f9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:52 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:52 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:52 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.438s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0daf249-846a-4b9a-87d4-7e30f7d40268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d2f13-862e-41c2-8313-6ad4e0f14f7f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:52 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268
Sep 12 21:05:52 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:53 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268" returned: 0 in 0.482s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:53 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:53 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:53 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.373s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:53 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246
Sep 12 21:05:53 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:53 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268.cf6231e0-d700-4b89-aa33-8989810e2246" returned: 0 in 0.260s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-quobyte-cf6231e0-d700-4b89-aa33-8989810e2246" released by "_delete_snapshot" :: held 1.697s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" released by "delete_snapshot" :: held 1.727s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Created reservations ['806bd6cd-6b43-4176-9c05-c0442f6faf5d', '4aa94a21-6a2c-4c92-a2b6-33c8d689b57c', 'f7cd83c6-8b57-404b-b8b6-ab9ca63b487a', 'b04cc272-5d2b-4e3d-9d61-7aadd1b15042'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Delete snapshot completed successfully.
Sep 12 21:05:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-903fbf57-8a4a-4ff8-92ca-854b001f4b32 tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-cf6231e0-d700-4b89-aa33-8989810e2246-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "cinder-a0daf249-846a-4b9a-87d4-7e30f7d40268-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-a0daf249-846a-4b9a-87d4-7e30f7d40268-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522d93c-7e83-4091-8bed-23cf153eaeb2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:54 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268
Sep 12 21:05:54 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:54 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268" returned: 0 in 0.400s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:54 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268
Sep 12 21:05:54 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:55 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a0daf249-846a-4b9a-87d4-7e30f7d40268" returned: 0 in 0.296s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-quobyte-a0daf249-846a-4b9a-87d4-7e30f7d40268" released by "delete_volume" :: held 0.768s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Created reservations ['1a16ba54-695f-479d-9fa3-26c435d2d7f9', '3575b5d3-6ba4-4196-afce-5476e9273678', 'e87dea68-c74d-4fff-a771-4a7912d91055', '5ec599d6-e4dd-415e-9028-77943fbddf23'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:05:55 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:05:55 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:05:55 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.292s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:05:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Deleted volume successfully.
Sep 12 21:05:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-37847ce8-d0bf-47c2-a2b1-a75184e6558e tempest-SnapshotsActionsTest-133492461 None] Lock "cinder-a0daf249-846a-4b9a-87d4-7e30f7d40268-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Flow 'volume_create_manager' (ba401e93-03e9-41a9-b77e-ee0b599368c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eadc5b7-3dd0-4ad1-abe8-2456562df02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eadc5b7-3dd0-4ad1-abe8-2456562df02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1149003026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c146890d-049a-4bc1-86cf-39a65a03dceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3d62fddb6d4d32a557088f8b3a586a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:02Z,use_quota=True,user_id='1a0e1ccfe7844412bfdddb82df1b1e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32da9c13-e0a1-47b9-bce6-8c27cfdf7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32da9c13-e0a1-47b9-bce6-8c27cfdf7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc8e7bd-9725-450e-b188-7cd0238f924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc8e7bd-9725-450e-b188-7cd0238f924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c146890d-049a-4bc1-86cf-39a65a03dceb', 'volume_name': 'volume-c146890d-049a-4bc1-86cf-39a65a03dceb', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190d8729-2026-427b-a0db-6211fa1e82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190d8729-2026-427b-a0db-6211fa1e82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1c8dda-e5a8-441c-8513-0844e03ed855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:02 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Volume c146890d-049a-4bc1-86cf-39a65a03dceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c146890d-049a-4bc1-86cf-39a65a03dceb', 'volume_size': 1}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1149003026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c146890d-049a-4bc1-86cf-39a65a03dceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3d62fddb6d4d32a557088f8b3a586a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:02Z,use_quota=True,user_id='1a0e1ccfe7844412bfdddb82df1b1e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Creating volume c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:02 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:02 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb 1073741824
Sep 12 21:06:02 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:03 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb 1073741824" returned: 0 in 0.445s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:03 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb
Sep 12 21:06:03 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:03 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1c8dda-e5a8-441c-8513-0844e03ed855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c146890d-049a-4bc1-86cf-39a65a03dceb', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103341d8-715c-45db-8ad3-be178551617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Volume volume-c146890d-049a-4bc1-86cf-39a65a03dceb (c146890d-049a-4bc1-86cf-39a65a03dceb): created successfully
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103341d8-715c-45db-8ad3-be178551617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Flow 'volume_create_manager' (ba401e93-03e9-41a9-b77e-ee0b599368c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0a466ac5-059e-4bf8-a59e-69067e080f5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Created volume successfully.
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Creating offline snapshot c021d03d-a0ee-49c6-b35f-1c8c44b0540c of volume c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c51ce-b537-4d8b-a7e2-760aa779af22]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:03 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb
Sep 12 21:06:03 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:04 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb" returned: 0 in 0.443s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:04 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c 1G
Sep 12 21:06:04 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:04 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c 1G" returned: 0 in 0.411s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c146890d-049a-4bc1-86cf-39a65a03dceb -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:04 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c146890d-049a-4bc1-86cf-39a65a03dceb -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c
Sep 12 21:06:04 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:04 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c146890d-049a-4bc1-86cf-39a65a03dceb -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c" returned: 0 in 0.303s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:04 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c is being set with open permissions: ugo+rw
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:05 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c
Sep 12 21:06:05 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:05 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c" returned: 0 in 0.285s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:05 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info
Sep 12 21:06:05 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:05 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info" returned: 0 in 0.263s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:05 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info is being set with open permissions: ugo+rw
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:05 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info
Sep 12 21:06:05 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:05 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.info" returned: 0 in 0.247s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cf1956c6-df13-4191-82da-cfa08ce89291 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Create snapshot completed successfully
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "cinder-c021d03d-a0ee-49c6-b35f-1c8c44b0540c-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-c021d03d-a0ee-49c6-b35f-1c8c44b0540c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "cinder-quobyte-c146890d-049a-4bc1-86cf-39a65a03dceb" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-quobyte-c146890d-049a-4bc1-86cf-39a65a03dceb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "cinder-quobyte-c021d03d-a0ee-49c6-b35f-1c8c44b0540c" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-quobyte-c021d03d-a0ee-49c6-b35f-1c8c44b0540c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Deleting offline snapshot c021d03d-a0ee-49c6-b35f-1c8c44b0540c of volume c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] snapshot_file for this snap is: volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e696e6ac-3d77-43f5-a466-5a13ac4a98e4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:07 devstack sudo[102275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c
Sep 12 21:06:07 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Flow 'volume_create_manager' (c7d5ac97-430d-4455-94c1-242f0267dd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b07ad38-843c-47de-a4d1-78d7b6be6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b07ad38-843c-47de-a4d1-78d7b6be6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-850893119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced33c65-608f-4fe5-8fe1-fbbfde6a338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a923885f5654d558dd097af7b31488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:08Z,use_quota=True,user_id='5d66ef4db46e477ab3753294a2bba068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bcf620d-d2f4-4b46-aaf3-b34b49a50f00),volume_type_id=7bcf620d-d2f4-4b46-aaf3-b34b49a50f00)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a205b47-a6a5-425b-85b7-4aa666b5f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a205b47-a6a5-425b-85b7-4aa666b5f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f7cd31-33d1-4ed6-a6aa-35046cdc1ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f7cd31-33d1-4ed6-a6aa-35046cdc1ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced33c65-608f-4fe5-8fe1-fbbfde6a338b', 'volume_name': 'volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9ae5f1-9527-430e-8d0b-6b1743a78a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9ae5f1-9527-430e-8d0b-6b1743a78a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f82022-554a-444d-97e6-9ac5df039cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume ced33c65-608f-4fe5-8fe1-fbbfde6a338b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b', 'volume_size': 1}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-850893119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced33c65-608f-4fe5-8fe1-fbbfde6a338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a923885f5654d558dd097af7b31488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:08Z,use_quota=True,user_id='5d66ef4db46e477ab3753294a2bba068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bcf620d-d2f4-4b46-aaf3-b34b49a50f00),volume_type_id=7bcf620d-d2f4-4b46-aaf3-b34b49a50f00)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Creating volume ced33c65-608f-4fe5-8fe1-fbbfde6a338b {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:07 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b 1073741824
Sep 12 21:06:07 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:07 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c" returned: 0 in 0.424s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c146890d-049a-4bc1-86cf-39a65a03dceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a519e4-fc07-46c1-a903-90bb38d4a97b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:08 devstack sudo[102282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb
Sep 12 21:06:08 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Flow 'volume_create_manager' (43df303a-0fbb-4859-ae40-c939f0a27bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265db816-06b6-48c4-a3ce-323719376535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265db816-06b6-48c4-a3ce-323719376535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2038599021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12afaa2-7208-4d39-9cf3-b41b4564c08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a923885f5654d558dd097af7b31488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:08Z,use_quota=True,user_id='5d66ef4db46e477ab3753294a2bba068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cb3ae4f-78d7-4afe-bdd0-b968fe0b7053),volume_type_id=1cb3ae4f-78d7-4afe-bdd0-b968fe0b7053)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d450e918-fd17-4cdb-b2e7-b63314ab94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d450e918-fd17-4cdb-b2e7-b63314ab94be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b5c680-94be-4df4-ab01-4f908caf1f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b5c680-94be-4df4-ab01-4f908caf1f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12afaa2-7208-4d39-9cf3-b41b4564c08f', 'volume_name': 'volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dfaebe-a198-49c2-9105-29be6aae5f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dfaebe-a198-49c2-9105-29be6aae5f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704b69c-189c-4ccc-91ae-8ece181a3be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume c12afaa2-7208-4d39-9cf3-b41b4564c08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f', 'volume_size': 1}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:08 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b 1073741824" returned: 0 in 0.579s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:08 devstack sudo[102288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b
Sep 12 21:06:08 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:08 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb" returned: 0 in 0.468s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:08 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c
Sep 12 21:06:08 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:08 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" returned: 0 in 0.294s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2038599021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12afaa2-7208-4d39-9cf3-b41b4564c08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a923885f5654d558dd097af7b31488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:08Z,use_quota=True,user_id='5d66ef4db46e477ab3753294a2bba068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cb3ae4f-78d7-4afe-bdd0-b968fe0b7053),volume_type_id=1cb3ae4f-78d7-4afe-bdd0-b968fe0b7053)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Creating volume c12afaa2-7208-4d39-9cf3-b41b4564c08f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:08 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:08 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f 1073741824
Sep 12 21:06:08 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f82022-554a-444d-97e6-9ac5df039cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431ff11a-dbf2-4e65-8556-a493db7cfbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b (ced33c65-608f-4fe5-8fe1-fbbfde6a338b): created successfully
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431ff11a-dbf2-4e65-8556-a493db7cfbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Flow 'volume_create_manager' (c7d5ac97-430d-4455-94c1-242f0267dd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Flow 'volume_create_manager' (8ef0d919-a114-4241-a22f-b3ec9bfd7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7eda2f-251c-4bb2-af7a-7bcd58c14181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3d85082d-3d0b-4ac5-b88f-ace46589d724 tempest-TestInstancesWithCinderVolumes-1662807652 None] Created volume successfully.
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7eda2f-251c-4bb2-af7a-7bcd58c14181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-40939511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94570fb3-757c-4d95-b2ff-0628b57d1c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a923885f5654d558dd097af7b31488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:09Z,use_quota=True,user_id='5d66ef4db46e477ab3753294a2bba068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92de348d-1818-4721-9dad-02ccf1d44fae),volume_type_id=92de348d-1818-4721-9dad-02ccf1d44fae)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962469f8-92e0-4ae9-9d13-014f0682df11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962469f8-92e0-4ae9-9d13-014f0682df11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c85003-965c-4a30-9dc0-f6ed7cbcf4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:06:08 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c" returned: 0 in 0.379s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:08 devstack sudo[102300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c
Sep 12 21:06:08 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c85003-965c-4a30-9dc0-f6ed7cbcf4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94570fb3-757c-4d95-b2ff-0628b57d1c05', 'volume_name': 'volume-94570fb3-757c-4d95-b2ff-0628b57d1c05', 'volume_size': 1, 'image_id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1053204671', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a923885f5654d558dd097af7b31488e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'created_at': datetime.datetime(2026, 9, 12, 19, 6, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 6, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d163f0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56515652-9489-419f-86f5-ea3a828badd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56515652-9489-419f-86f5-ea3a828badd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb84f7e-324c-4f98-a8e5-3499d7ebc733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume 94570fb3-757c-4d95-b2ff-0628b57d1c05: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94570fb3-757c-4d95-b2ff-0628b57d1c05', 'volume_size': 1, 'image_id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1053204671', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a923885f5654d558dd097af7b31488e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'created_at': datetime.datetime(2026, 9, 12, 19, 6, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 6, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d163f0>}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Trying to clone 94570fb3-757c-4d95-b2ff-0628b57d1c05 from image 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:06:09 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb.c021d03d-a0ee-49c6-b35f-1c8c44b0540c" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:09 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f 1073741824" returned: 0 in 0.489s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-quobyte-c021d03d-a0ee-49c6-b35f-1c8c44b0540c" released by "_delete_snapshot" :: held 1.717s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-quobyte-c146890d-049a-4bc1-86cf-39a65a03dceb" released by "delete_snapshot" :: held 1.747s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:09 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f
Sep 12 21:06:09 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Created reservations ['9d088386-f713-45be-8a6a-d67c7825dbbd', '48bf0386-f3d1-420d-b022-ed7055b984fb', 'a84f87ec-5153-4760-adda-8a8726aaa480', 'da1e0f53-0b01-4e13-b1d4-4ac544cf36ec'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Delete snapshot completed successfully.
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e17cc88c-c9f8-4e32-8bbb-d54a1ff25dae tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-c021d03d-a0ee-49c6-b35f-1c8c44b0540c-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:09 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704b69c-189c-4ccc-91ae-8ece181a3be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224cc445-19ba-4676-aa14-833f6b97dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f (c12afaa2-7208-4d39-9cf3-b41b4564c08f): created successfully
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224cc445-19ba-4676-aa14-833f6b97dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Flow 'volume_create_manager' (43df303a-0fbb-4859-ae40-c939f0a27bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3fd173c7-9293-420e-a58c-a56757585670 tempest-TestInstancesWithCinderVolumes-1662807652 None] Created volume successfully.
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "cinder-c146890d-049a-4bc1-86cf-39a65a03dceb-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-c146890d-049a-4bc1-86cf-39a65a03dceb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "cinder-quobyte-c146890d-049a-4bc1-86cf-39a65a03dceb" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-quobyte-c146890d-049a-4bc1-86cf-39a65a03dceb" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c7ab8-d9d5-4201-bee5-56c7af08c22f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:09 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb
Sep 12 21:06:09 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:10 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb" returned: 0 in 0.374s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:10 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb
Sep 12 21:06:10 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:10 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c146890d-049a-4bc1-86cf-39a65a03dceb" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-quobyte-c146890d-049a-4bc1-86cf-39a65a03dceb" released by "delete_volume" :: held 0.699s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Created reservations ['8fa09bf8-7453-4b8a-8863-2d79e806f050', 'bd608b2b-38c7-4ed8-ba18-b9223f54af8b', '4a61684a-b28d-4a4c-9aa8-e18c1c42e3fe', '469bb3e0-53eb-4214-9b9c-54a148f28933'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:10 devstack sudo[102317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:10 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:10 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Deleted volume successfully.
Sep 12 21:06:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4e741e97-a17f-4fcb-ae22-3d7be9f28672 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029982937 None] Lock "cinder-c146890d-049a-4bc1-86cf-39a65a03dceb-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:12 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD, size 20.69 MB, duration 3.70 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:06:12 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Image download 20.69 MB at 5.59 MB/s
Sep 12 21:06:12 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a869cd0-584a-4f25-841a-dfeed4e1f679]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:13 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD
Sep 12 21:06:13 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:13 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Temporary image 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 is fetched for user 5d66ef4db46e477ab3753294a2bba068. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[37857db9-73ba-49d9-a9d6-7ffa954ff178]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b408a2-aab3-45f1-a6a8-d5b8b513f1d9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:13 devstack sudo[102341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD
Sep 12 21:06:13 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:13 devstack sudo[102342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee
Sep 12 21:06:13 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:13 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:13 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.410s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-40939511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94570fb3-757c-4d95-b2ff-0628b57d1c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a923885f5654d558dd097af7b31488e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:09Z,use_quota=True,user_id='5d66ef4db46e477ab3753294a2bba068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92de348d-1818-4721-9dad-02ccf1d44fae),volume_type_id=92de348d-1818-4721-9dad-02ccf1d44fae)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Creating volume 94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:13 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:13 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 1073741824
Sep 12 21:06:13 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-4b212021-b712-4589-bb5f-cd556a0739ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '884cfa50-9a83-45cb-950b-4f26b5dd3a0c', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:06:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-c9871246-d442-4d42-9900-fd57e105d6a0 req-40543937-e6d5-452d-b3e3-1e047117e761 tempest-TestStampPattern-212468362 None] attachment_update completed successfully.
Sep 12 21:06:14 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 1073741824" returned: 0 in 0.525s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:14 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:06:14 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:14 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Attempting download of 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'metadata': {}}])) to volume 94570fb3-757c-4d95-b2ff-0628b57d1c05. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e9cff-4261-446a-9231-03887f6d8acc]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:14 devstack sudo[102743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk
Sep 12 21:06:15 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:15 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk" returned: 0 in 0.354s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:15 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk
Sep 12 21:06:15 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:15 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk" returned: 1 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_yzvit5fk' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ba1b9-c842-4201-9ba1-5e0c5f7f1ffa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:15 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD
Sep 12 21:06:15 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:15 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 was qcow2, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:06:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:15 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:06:15 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-dfbc94b0-7d23-4024-8522-2a4faee51cb9 req-7f9b5928-c1dd-4afb-9573-84f29ac0e4a2 tempest-TestStampPattern-212468362 None] Terminate volume connection completed successfully.
Sep 12 21:06:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-dfbc94b0-7d23-4024-8522-2a4faee51cb9 req-7f9b5928-c1dd-4afb-9573-84f29ac0e4a2 tempest-TestStampPattern-212468362 None] Deleting attachment 884cfa50-9a83-45cb-950b-4f26b5dd3a0c. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:06:17 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 0 in 1.756s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:17 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a22efb-20de-4eb3-b513-c46bcd1c3ec5_jvpopsk8devstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:06:17 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Converted 112.00 MB image at 63.74 MB/s
Sep 12 21:06:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:17 devstack sudo[102807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 1G
Sep 12 21:06:17 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:18 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 1G" returned: 0 in 0.335s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad2bf6-b917-484c-9da1-244b69b76772]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:18 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:06:18 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:18 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 0 in 0.515s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:18 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:06:18 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:19 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 1 in 0.617s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Downloaded image 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 ((None, [{'url': 'file:///opt/stack/data/glance/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'metadata': {}}])) to volume 94570fb3-757c-4d95-b2ff-0628b57d1c05 successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Temporary image 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 for user 5d66ef4db46e477ab3753294a2bba068 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Marking volume 94570fb3-757c-4d95-b2ff-0628b57d1c05 as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Copying metadata from image 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 to 94570fb3-757c-4d95-b2ff-0628b57d1c05. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Creating volume glance metadata for volume 94570fb3-757c-4d95-b2ff-0628b57d1c05 backed by image 11a22efb-20de-4eb3-b513-c46bcd1c3ec5 with: {'image_id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'image_name': 'tempest-scenario-img--1053204671', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb84f7e-324c-4f98-a8e5-3499d7ebc733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94570fb3-757c-4d95-b2ff-0628b57d1c05', 'volume_size': 1, 'image_id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1053204671', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1a923885f5654d558dd097af7b31488e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a22efb-20de-4eb3-b513-c46bcd1c3ec5', 'created_at': datetime.datetime(2026, 9, 12, 19, 6, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 6, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a22efb-20de-4eb3-b513-c46bcd1c3ec5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d163f0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4291ca2-0d7d-4627-993e-628fb035278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:19 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Volume volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 (94570fb3-757c-4d95-b2ff-0628b57d1c05): created successfully
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4291ca2-0d7d-4627-993e-628fb035278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:19 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Flow 'volume_create_manager' (8ef0d919-a114-4241-a22f-b3ec9bfd7359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c247f20b-12ce-4b54-981e-1b0837f4018b tempest-TestInstancesWithCinderVolumes-1662807652 None] Created volume successfully.
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-4b212021-b712-4589-bb5f-cd556a0739ee-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Lock "cinder-4b212021-b712-4589-bb5f-cd556a0739ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-quobyte-4b212021-b712-4589-bb5f-cd556a0739ee" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-4b212021-b712-4589-bb5f-cd556a0739ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae83666-8d05-4016-867c-27ae67657f40]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:21 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee
Sep 12 21:06:21 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:21 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee" returned: 0 in 0.456s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:21 devstack sudo[102863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee
Sep 12 21:06:21 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:22 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4b212021-b712-4589-bb5f-cd556a0739ee" returned: 0 in 0.296s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-4b212021-b712-4589-bb5f-cd556a0739ee" released by "delete_volume" :: held 0.797s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=90,cinder:UPDATE=80,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Created reservations ['897df0cd-6c45-4755-a6b3-8fb8559ea26b', '93b08c23-9450-43f9-854c-30cddd34d991', '5cbf1b65-6e64-4a3e-8322-750731b870ae', '457de9e5-70a7-4ffc-87a0-eb3c6195bb4c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:22 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:22 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:22 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.333s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Deleted volume successfully.
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a1d0e351-8ad3-4ee4-b898-057b390ff454 tempest-TestStampPattern-212468362 None] Lock "cinder-4b212021-b712-4589-bb5f-cd556a0739ee-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-155dcc6e-7e51-4b1c-b1ca-8b438767b378-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Lock "cinder-155dcc6e-7e51-4b1c-b1ca-8b438767b378-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-quobyte-bd11adb7-b990-4e61-9906-8c07177cecef" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-bd11adb7-b990-4e61-9906-8c07177cecef" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-quobyte-155dcc6e-7e51-4b1c-b1ca-8b438767b378" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-155dcc6e-7e51-4b1c-b1ca-8b438767b378" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Deleting offline snapshot 155dcc6e-7e51-4b1c-b1ca-8b438767b378 of volume bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] snapshot_file for this snap is: volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c7217-5db8-4930-a3ed-1564306362e9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:23 devstack sudo[102869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378
Sep 12 21:06:23 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:23 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378" returned: 0 in 0.525s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd11adb7-b990-4e61-9906-8c07177cecef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308cfc7-6cbe-4a33-8a44-9b3cd2228091]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:23 devstack sudo[102881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:06:23 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca765616-b291-4b62-8473-78844ea57778]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:23 devstack sudo[102884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:06:23 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:24 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.601s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:24 devstack sudo[102892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378
Sep 12 21:06:24 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:24 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 0 in 0.528s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:24 devstack sudo[102894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:06:24 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:24 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 1 in 0.464s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.050s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:24 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378" returned: 0 in 0.641s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:24 devstack sudo[102903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378
Sep 12 21:06:24 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-94570fb3-757c-4d95-b2ff-0628b57d1c05', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2b28014-f15d-4f66-a2a3-02fbb781de2a', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:06:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-6868d6e5-37db-464e-bbf4-b8f7c0a1b49a req-c9d79b80-f2f9-4e2f-aeff-dac1cb245f83 tempest-TestInstancesWithCinderVolumes-1662807652 None] attachment_update completed successfully.
Sep 12 21:06:25 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef.155dcc6e-7e51-4b1c-b1ca-8b438767b378" returned: 0 in 0.378s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-155dcc6e-7e51-4b1c-b1ca-8b438767b378" released by "_delete_snapshot" :: held 2.316s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-bd11adb7-b990-4e61-9906-8c07177cecef" released by "delete_snapshot" :: held 2.350s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:25 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Created reservations ['399f36a0-fd48-4966-854c-19bf26ba1aab', '7529a7d3-07b6-4569-8c91-dc8a464b9f71', '775c68f1-f4ed-4f37-aca8-9daccb7a91b7', 'b496670c-7ea9-4bcf-8763-460ea9ba01e4'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Delete snapshot completed successfully.
Sep 12 21:06:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eea4c484-516d-41e0-acd6-3d1d459225c3 tempest-TestStampPattern-212468362 None] Lock "cinder-155dcc6e-7e51-4b1c-b1ca-8b438767b378-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-bd11adb7-b990-4e61-9906-8c07177cecef-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Lock "cinder-bd11adb7-b990-4e61-9906-8c07177cecef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Acquiring lock "cinder-quobyte-bd11adb7-b990-4e61-9906-8c07177cecef" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-bd11adb7-b990-4e61-9906-8c07177cecef" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5c31f-8e34-499d-8db0-6585056eecb5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:30 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:06:30 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:30 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.588s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:30 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef
Sep 12 21:06:30 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:30 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-bd11adb7-b990-4e61-9906-8c07177cecef" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Lock "cinder-quobyte-bd11adb7-b990-4e61-9906-8c07177cecef" released by "delete_volume" :: held 1.041s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Created reservations ['46ba0bc9-3b25-4c25-8c4c-ee04489cf9ca', 'a736da40-a153-4aaa-8cbf-096af26e00fd', '3ecb0af3-a0da-4b5d-b594-4defce64f7b9', 'bd98e094-b85f-4408-b47b-bfa295568ad1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:31 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:31 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:31 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Deleted volume successfully.
Sep 12 21:06:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e1b5b22c-498c-47af-9968-52cc6eeac26b tempest-TestStampPattern-212468362 None] Lock "cinder-bd11adb7-b990-4e61-9906-8c07177cecef-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:33 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:33 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:33 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.386s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Flow 'volume_create_manager' (9b0a19dc-da0d-4846-91c4-6770fef01e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a31a6a8-59fb-4252-abd9-ff713566de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a31a6a8-59fb-4252-abd9-ff713566de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-580845871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acc327d-d9fb-490c-8765-8a95ce7b8dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180f9e4bbb840c7b5e853253933aaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:35Z,use_quota=True,user_id='00130ecd7a724573a3d74aba8e685af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad18ac9c-3d2e-4466-93fb-dc0efd4785fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad18ac9c-3d2e-4466-93fb-dc0efd4785fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56aae3f0-4ef7-49f2-bcc1-4ecdda0ce982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56aae3f0-4ef7-49f2-bcc1-4ecdda0ce982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acc327d-d9fb-490c-8765-8a95ce7b8dde', 'volume_name': 'volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d16dc43-e74f-44dd-9e18-23fed09a8119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d16dc43-e74f-44dd-9e18-23fed09a8119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615b7784-bb5e-4537-b02e-26771838b559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:35 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Volume 6acc327d-d9fb-490c-8765-8a95ce7b8dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde', 'volume_size': 1}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-580845871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acc327d-d9fb-490c-8765-8a95ce7b8dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180f9e4bbb840c7b5e853253933aaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:35Z,use_quota=True,user_id='00130ecd7a724573a3d74aba8e685af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Creating volume 6acc327d-d9fb-490c-8765-8a95ce7b8dde {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:35 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:35 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde 1073741824
Sep 12 21:06:35 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:36 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde 1073741824" returned: 0 in 0.744s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:36 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde
Sep 12 21:06:36 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:36 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde" returned: 0 in 0.339s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615b7784-bb5e-4537-b02e-26771838b559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57965d7-6951-4d6a-b5c1-68993e0e3346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:36 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Volume volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde (6acc327d-d9fb-490c-8765-8a95ce7b8dde): created successfully
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57965d7-6951-4d6a-b5c1-68993e0e3346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Flow 'volume_create_manager' (9b0a19dc-da0d-4846-91c4-6770fef01e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-06016b83-07c2-4e6e-9526-6c4513b8c014 tempest-VolumesListAdminTestJSON-198927513 None] Created volume successfully.
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Flow 'volume_create_manager' (1b85b5b7-537f-4469-ab40-cb663c13d974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639167f2-1757-4719-b02f-50431666ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639167f2-1757-4719-b02f-50431666ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-347744742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a7b4ae-bd0a-428d-88f0-962d424f6cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180f9e4bbb840c7b5e853253933aaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:38Z,use_quota=True,user_id='00130ecd7a724573a3d74aba8e685af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4266579e-fd7f-4fbc-b965-8e63bb092e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4266579e-fd7f-4fbc-b965-8e63bb092e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb83ec7-ce6d-43be-a924-615d646f7ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb83ec7-ce6d-43be-a924-615d646f7ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a7b4ae-bd0a-428d-88f0-962d424f6cc7', 'volume_name': 'volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228727b5-7493-4d26-9cd3-189414de6161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228727b5-7493-4d26-9cd3-189414de6161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efe9332-7fec-4c57-a8c5-ce1573377447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:37 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Volume 91a7b4ae-bd0a-428d-88f0-962d424f6cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7', 'volume_size': 1}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-347744742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a7b4ae-bd0a-428d-88f0-962d424f6cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180f9e4bbb840c7b5e853253933aaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:38Z,use_quota=True,user_id='00130ecd7a724573a3d74aba8e685af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Creating volume 91a7b4ae-bd0a-428d-88f0-962d424f6cc7 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:37 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:38 devstack sudo[103413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 1073741824
Sep 12 21:06:38 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:38 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 1073741824" returned: 0 in 0.671s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:38 devstack sudo[103419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7
Sep 12 21:06:38 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:38 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efe9332-7fec-4c57-a8c5-ce1573377447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e961e2e-80b7-48be-b638-36a5e503f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Volume volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 (91a7b4ae-bd0a-428d-88f0-962d424f6cc7): created successfully
Sep 12 21:06:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e961e2e-80b7-48be-b638-36a5e503f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Flow 'volume_create_manager' (1b85b5b7-537f-4469-ab40-cb663c13d974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:39 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-95184465-ac1c-4e36-964e-fad184a27391 tempest-VolumesListAdminTestJSON-198927513 None] Created volume successfully.
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Flow 'volume_create_manager' (8e412616-9dd9-4932-9d9e-081b4ed41e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d48d1-b46c-484b-87aa-90a31535a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d48d1-b46c-484b-87aa-90a31535a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-640335668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a05050-3b5a-43a6-acc6-f9c3f15b11a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180f9e4bbb840c7b5e853253933aaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:41Z,use_quota=True,user_id='00130ecd7a724573a3d74aba8e685af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d63a3b-eac2-43aa-be41-776698cfb6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d63a3b-eac2-43aa-be41-776698cfb6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2d44de-679c-4d45-98d0-d24af8a5f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2d44de-679c-4d45-98d0-d24af8a5f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a05050-3b5a-43a6-acc6-f9c3f15b11a7', 'volume_name': 'volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c856e6e9-e637-4b64-87a4-5727bf38abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c856e6e9-e637-4b64-87a4-5727bf38abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7ffd9c-6305-43a7-9186-064f337898eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Volume b2a05050-3b5a-43a6-acc6-f9c3f15b11a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7', 'volume_size': 1}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-640335668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a05050-3b5a-43a6-acc6-f9c3f15b11a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b180f9e4bbb840c7b5e853253933aaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:41Z,use_quota=True,user_id='00130ecd7a724573a3d74aba8e685af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Creating volume b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:40 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:40 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 1073741824
Sep 12 21:06:40 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:41 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 1073741824" returned: 0 in 0.585s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:41 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7
Sep 12 21:06:41 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:41 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7ffd9c-6305-43a7-9186-064f337898eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb5d5b1-ce71-482a-a2f7-05cda312390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Volume volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 (b2a05050-3b5a-43a6-acc6-f9c3f15b11a7): created successfully
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb5d5b1-ce71-482a-a2f7-05cda312390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Flow 'volume_create_manager' (8e412616-9dd9-4932-9d9e-081b4ed41e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6ab9eccc-74cf-465b-813e-e15917932824 tempest-VolumesListAdminTestJSON-198927513 None] Created volume successfully.
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Flow 'volume_create_manager' (fa75ea61-bec2-40b7-b6c1-03c6289c7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fb0458-26f0-45ba-bf00-77c0d5326493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fb0458-26f0-45ba-bf00-77c0d5326493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bebf896-096e-4e45-9cbe-381f8e09dc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dd58f6db4644a58ec8f55cc8508f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:44Z,use_quota=True,user_id='e940c8c20c4945c58f2cb339feec6796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fdf226-be91-4f87-a264-253fbfc35e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fdf226-be91-4f87-a264-253fbfc35e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55eb963f-a9ad-496e-9890-466bde573f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55eb963f-a9ad-496e-9890-466bde573f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bebf896-096e-4e45-9cbe-381f8e09dc67', 'volume_name': 'volume-3bebf896-096e-4e45-9cbe-381f8e09dc67', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3616311f-5792-429c-af17-a4694d559df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3616311f-5792-429c-af17-a4694d559df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fce61e-3d35-4ec8-8783-3f4f767d3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:43 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Volume 3bebf896-096e-4e45-9cbe-381f8e09dc67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bebf896-096e-4e45-9cbe-381f8e09dc67', 'volume_size': 1}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bebf896-096e-4e45-9cbe-381f8e09dc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dd58f6db4644a58ec8f55cc8508f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:44Z,use_quota=True,user_id='e940c8c20c4945c58f2cb339feec6796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Creating volume 3bebf896-096e-4e45-9cbe-381f8e09dc67 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:43 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:43 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 1073741824
Sep 12 21:06:43 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:44 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 1073741824" returned: 0 in 0.496s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:44 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67
Sep 12 21:06:44 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:44 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fce61e-3d35-4ec8-8783-3f4f767d3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bebf896-096e-4e45-9cbe-381f8e09dc67', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3243fdc4-b263-435f-afd9-1cd19c31ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:44 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Volume volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 (3bebf896-096e-4e45-9cbe-381f8e09dc67): created successfully
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3243fdc4-b263-435f-afd9-1cd19c31ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Flow 'volume_create_manager' (fa75ea61-bec2-40b7-b6c1-03c6289c7709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b24bfe5d-282f-487d-9aca-552425901ca4 tempest-VolumesListAdminTestJSON-1150829898 None] Created volume successfully.
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Acquiring lock "cinder-3bebf896-096e-4e45-9cbe-381f8e09dc67-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "cinder-3bebf896-096e-4e45-9cbe-381f8e09dc67-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Acquiring lock "cinder-quobyte-3bebf896-096e-4e45-9cbe-381f8e09dc67" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "cinder-quobyte-3bebf896-096e-4e45-9cbe-381f8e09dc67" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff75022f-a2c4-4b3a-afa7-bf6428d01dcc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "cinder-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:46 devstack sudo[103509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67
Sep 12 21:06:46 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "cinder-quobyte-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-quobyte-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5189c6-f4a6-43ba-9e88-4086b740ffc6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:46 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7
Sep 12 21:06:46 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:46 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67" returned: 0 in 0.474s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:46 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67
Sep 12 21:06:46 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:46 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:46 devstack sudo[103546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7
Sep 12 21:06:46 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:47 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3bebf896-096e-4e45-9cbe-381f8e09dc67" returned: 0 in 0.300s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "cinder-quobyte-3bebf896-096e-4e45-9cbe-381f8e09dc67" released by "delete_volume" :: held 0.866s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Created reservations ['90725913-3735-4b1e-8c68-e0f266869fa6', 'b76b4b22-26e8-448e-b41a-62361c762142', 'fd420d33-aa95-4c01-921a-0def6b29f12b', '1480e315-b4c6-42b4-b031-699361f35962'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:47 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7" returned: 0 in 0.279s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:47 devstack sudo[103550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:47 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-quobyte-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7" released by "delete_volume" :: held 0.796s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Created reservations ['492e7b7b-ce99-444e-b392-6c1e499552de', 'e28e4380-72c3-4496-bf06-4f1f1ce35822', '961b2503-9230-4e24-8b89-75fb92aa09b8', '610c0e5e-bb98-48f6-ba03-ada4284b3876'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:47 devstack sudo[103552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:47 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:47 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.291s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Deleted volume successfully.
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f51c7e91-6fd5-4c81-93ef-23f8f52e8965 tempest-VolumesListAdminTestJSON-1150829898 None] Lock "cinder-3bebf896-096e-4e45-9cbe-381f8e09dc67-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "cinder-91a7b4ae-bd0a-428d-88f0-962d424f6cc7-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-91a7b4ae-bd0a-428d-88f0-962d424f6cc7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "cinder-quobyte-91a7b4ae-bd0a-428d-88f0-962d424f6cc7" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-quobyte-91a7b4ae-bd0a-428d-88f0-962d424f6cc7" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:47 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.345s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Deleted volume successfully.
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5261b1-59c6-4c74-a389-7c91faab18b3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8f1b1619-da98-4fc9-a644-c6a97cd39d36 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-b2a05050-3b5a-43a6-acc6-f9c3f15b11a7-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:47 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7
Sep 12 21:06:47 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:48 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7" returned: 0 in 0.403s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:48 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7
Sep 12 21:06:48 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:48 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (2cf1099c-b932-4dd6-bc00-478afa7fbe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79504d25-db86-444c-bc8f-1970c918411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-91a7b4ae-bd0a-428d-88f0-962d424f6cc7" returned: 0 in 0.285s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79504d25-db86-444c-bc8f-1970c918411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-438813099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45309842-33c9-4a11-b96b-2397ae805442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:48Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a7521-279c-4f20-a846-df09227cc05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a7521-279c-4f20-a846-df09227cc05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3712171-f331-419b-8767-958265025cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3712171-f331-419b-8767-958265025cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45309842-33c9-4a11-b96b-2397ae805442', 'volume_name': 'volume-45309842-33c9-4a11-b96b-2397ae805442', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e611d8-569f-4c34-b3ed-cf9f4861e17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e611d8-569f-4c34-b3ed-cf9f4861e17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21704f7a-2a38-44e8-9dac-330b48dc4e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:48 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume 45309842-33c9-4a11-b96b-2397ae805442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45309842-33c9-4a11-b96b-2397ae805442', 'volume_size': 1}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-438813099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45309842-33c9-4a11-b96b-2397ae805442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:48Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating volume 45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:48 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-quobyte-91a7b4ae-bd0a-428d-88f0-962d424f6cc7" released by "delete_volume" :: held 0.806s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:48 devstack sudo[103564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 1073741824
Sep 12 21:06:48 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Created reservations ['8062eaeb-878b-4854-8a26-d6b99fae96a5', 'eda4affd-4aab-4376-ae90-8e86ea7129f8', '3a630b45-ed22-4006-8e40-4661ff7b0751', 'eb307715-e52c-41df-a111-b5bcb0bc7c67'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:48 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:48 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "cinder-6acc327d-d9fb-490c-8765-8a95ce7b8dde-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:48 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-6acc327d-d9fb-490c-8765-8a95ce7b8dde-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.274s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Deleted volume successfully.
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7807a377-ab79-4f71-a468-f7a454968a6c tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-91a7b4ae-bd0a-428d-88f0-962d424f6cc7-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "cinder-quobyte-6acc327d-d9fb-490c-8765-8a95ce7b8dde" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-quobyte-6acc327d-d9fb-490c-8765-8a95ce7b8dde" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:49 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7210e-ea22-4714-ba29-7830a06e2d38]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 1073741824" returned: 0 in 0.524s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:49 devstack sudo[103575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442
Sep 12 21:06:49 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:49 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde
Sep 12 21:06:49 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:49 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21704f7a-2a38-44e8-9dac-330b48dc4e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45309842-33c9-4a11-b96b-2397ae805442', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fffaf18-fc38-4624-ac82-0858dc5ae3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:49 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume volume-45309842-33c9-4a11-b96b-2397ae805442 (45309842-33c9-4a11-b96b-2397ae805442): created successfully
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fffaf18-fc38-4624-ac82-0858dc5ae3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (2cf1099c-b932-4dd6-bc00-478afa7fbe20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ecc9bba3-cd3a-43a4-ab5d-f39e35e58e50 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created volume successfully.
Sep 12 21:06:49 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde" returned: 0 in 0.389s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:49 devstack sudo[103583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde
Sep 12 21:06:49 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:49 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc327d-d9fb-490c-8765-8a95ce7b8dde" returned: 0 in 0.244s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-quobyte-6acc327d-d9fb-490c-8765-8a95ce7b8dde" released by "delete_volume" :: held 0.676s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Created reservations ['49b1f8e2-501a-48c7-b756-c5df71c162e4', 'd73cdd90-5d40-4d6a-988d-7a9f72299b6c', 'e3e8d7c6-6bce-432c-8ab3-ef539cbed6e5', 'df4607c6-2cc7-436c-8374-9b8a3865afe9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:49 devstack sudo[103586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:06:49 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:50 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.255s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:06:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Deleted volume successfully.
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db5351b1-0315-4de3-b27e-c02f19598071 tempest-VolumesListAdminTestJSON-198927513 None] Lock "cinder-6acc327d-d9fb-490c-8765-8a95ce7b8dde-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating offline snapshot 1254121e-8ae8-4e9d-a160-3f6daf3acbe9 of volume 45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c411d82-4e71-465f-b706-893b9f22b54b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:50 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442
Sep 12 21:06:50 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:51 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:51 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 1G
Sep 12 21:06:51 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:51 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 1G" returned: 0 in 0.449s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45309842-33c9-4a11-b96b-2397ae805442 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:51 devstack sudo[103601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45309842-33c9-4a11-b96b-2397ae805442 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9
Sep 12 21:06:51 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:51 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45309842-33c9-4a11-b96b-2397ae805442 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9" returned: 0 in 0.317s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:51 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 is being set with open permissions: ugo+rw
Sep 12 21:06:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:51 devstack sudo[103610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9
Sep 12 21:06:51 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:52 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9" returned: 0 in 0.255s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=122,cinder:SELECT=108,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:52 devstack sudo[103613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info
Sep 12 21:06:52 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:52 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:52 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info is being set with open permissions: ugo+rw
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:52 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info
Sep 12 21:06:52 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:52 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.info" returned: 0 in 0.254s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b075d32a-8a45-403b-842f-3b8ed53e5b20 tempest-CreateVolumesFromSnapshotTest-346267570 None] Create snapshot completed successfully
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (c780badc-86f9-45e2-bd0f-b4b8ecb4ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0385104-15c1-45f8-b70f-88cb206a42a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0385104-15c1-45f8-b70f-88cb206a42a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905226095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea12835c-f343-4d95-9fa5-5a72cc31e902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:54Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b18c9d7-74a3-476c-9551-c833baa5e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b18c9d7-74a3-476c-9551-c833baa5e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c01eac5-4eb7-403c-b134-d262918a3903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c01eac5-4eb7-403c-b134-d262918a3903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea12835c-f343-4d95-9fa5-5a72cc31e902', 'volume_name': 'volume-ea12835c-f343-4d95-9fa5-5a72cc31e902', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae80f0f-d44a-45bf-9d74-92df263912a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae80f0f-d44a-45bf-9d74-92df263912a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b931e8df-2cc9-4a29-920c-c2c15ebf0665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:54 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume ea12835c-f343-4d95-9fa5-5a72cc31e902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea12835c-f343-4d95-9fa5-5a72cc31e902', 'volume_size': 1}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-905226095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea12835c-f343-4d95-9fa5-5a72cc31e902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:54Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating volume ea12835c-f343-4d95-9fa5-5a72cc31e902 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:54 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:54 devstack sudo[103619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 1073741824
Sep 12 21:06:54 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (e1a68242-42d3-479a-a42c-355f0a23f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a4f930-a615-4ae1-95ff-d302191be9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a4f930-a615-4ae1-95ff-d302191be9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602585611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47e33a-7536-4b80-8d2e-b2527e1b1fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:55Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a363c54-ee2d-4195-816d-46d9ca0213a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a363c54-ee2d-4195-816d-46d9ca0213a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd90cdcc-18d7-4aee-966a-07d9e333c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd90cdcc-18d7-4aee-966a-07d9e333c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f47e33a-7536-4b80-8d2e-b2527e1b1fe3', 'volume_name': 'volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc37584b-ff0a-4091-bbb6-0a5df6891684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc37584b-ff0a-4091-bbb6-0a5df6891684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f854b19a-6113-4d3f-81c4-ff8d1ea15e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume 5f47e33a-7536-4b80-8d2e-b2527e1b1fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3', 'volume_size': 1}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:55 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 1073741824" returned: 0 in 0.715s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:55 devstack sudo[103624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902
Sep 12 21:06:55 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (781b3954-35f7-4db8-8079-17703daef20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5a7a2e-7089-4fac-ab6f-ec4876b033c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5a7a2e-7089-4fac-ab6f-ec4876b033c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512314238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf0eba5-31c1-415f-8f06-c7e99cb63ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:55Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5704486-2b66-46df-9ea1-ab2c39aea46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5704486-2b66-46df-9ea1-ab2c39aea46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf92632-9305-4fcb-ab19-e5fc2f3aec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf92632-9305-4fcb-ab19-e5fc2f3aec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf0eba5-31c1-415f-8f06-c7e99cb63ba8', 'volume_name': 'volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a3b058-34d4-47ff-a62f-3ddcf590164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a3b058-34d4-47ff-a62f-3ddcf590164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c96130-1fe7-415c-8f9d-64925b1d9d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume dbf0eba5-31c1-415f-8f06-c7e99cb63ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8', 'volume_size': 1}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:55 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902" returned: 0 in 0.486s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602585611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47e33a-7536-4b80-8d2e-b2527e1b1fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:55Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating volume 5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:55 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:55 devstack sudo[103627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 1073741824
Sep 12 21:06:55 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (3eb01a13-e253-424f-a03f-13f111f0950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731c42e-2628-4221-8d73-49834c669461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b931e8df-2cc9-4a29-920c-c2c15ebf0665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea12835c-f343-4d95-9fa5-5a72cc31e902', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df58424-0349-4019-ad2c-0f4a9bebab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731c42e-2628-4221-8d73-49834c669461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-933137834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13927cdf-365c-465c-97b0-d3cc286910d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:56Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbf45d5-b189-4120-8318-d772c6249cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbf45d5-b189-4120-8318-d772c6249cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e014b0-52f1-4c4b-8183-9d92aac89db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e014b0-52f1-4c4b-8183-9d92aac89db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13927cdf-365c-465c-97b0-d3cc286910d9', 'volume_name': 'volume-13927cdf-365c-465c-97b0-d3cc286910d9', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d466fded-32e2-40e4-b45a-8d5f713a1601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d466fded-32e2-40e4-b45a-8d5f713a1601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54fd5423-45c8-43cd-a8ab-d28b02e8d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume 13927cdf-365c-465c-97b0-d3cc286910d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13927cdf-365c-465c-97b0-d3cc286910d9', 'volume_size': 1}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 (ea12835c-f343-4d95-9fa5-5a72cc31e902): created successfully
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df58424-0349-4019-ad2c-0f4a9bebab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (c780badc-86f9-45e2-bd0f-b4b8ecb4ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9a53b6d2-0e3f-4766-8c69-ba1aff9af9f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created volume successfully.
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (b27a990d-e690-449d-8fe6-3b434c062213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc09702c-b5c9-48a9-8a8b-097d7ca13ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc09702c-b5c9-48a9-8a8b-097d7ca13ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1846687384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61642d49-b755-4ff1-b1d9-649c7ab7ee6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:56Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace45d17-554a-42c7-851b-a01e04cedce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace45d17-554a-42c7-851b-a01e04cedce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d496a1c6-1c84-4f16-aa57-4bc5a1125ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d496a1c6-1c84-4f16-aa57-4bc5a1125ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61642d49-b755-4ff1-b1d9-649c7ab7ee6e', 'volume_name': 'volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cee47a-a03b-4d4a-8ea7-48ce5c190ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cee47a-a03b-4d4a-8ea7-48ce5c190ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c3e32a-703d-469b-b333-3fb8d243154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:56 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume 61642d49-b755-4ff1-b1d9-649c7ab7ee6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e', 'volume_size': 1}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:56 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 1073741824" returned: 0 in 0.663s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:56 devstack sudo[103632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3
Sep 12 21:06:56 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:56 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3" returned: 0 in 0.400s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512314238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf0eba5-31c1-415f-8f06-c7e99cb63ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:55Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating volume dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:56 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:56 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 1073741824
Sep 12 21:06:56 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f854b19a-6113-4d3f-81c4-ff8d1ea15e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146ea06b-6594-4dc8-8328-41964a316652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 (5f47e33a-7536-4b80-8d2e-b2527e1b1fe3): created successfully
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146ea06b-6594-4dc8-8328-41964a316652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (e1a68242-42d3-479a-a42c-355f0a23f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4279430c-3f12-48ce-9e64-991fb8be5230 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created volume successfully.
Sep 12 21:06:57 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 1073741824" returned: 0 in 0.523s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:57 devstack sudo[103643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8
Sep 12 21:06:57 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:57 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8" returned: 0 in 0.251s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-933137834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13927cdf-365c-465c-97b0-d3cc286910d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:56Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating volume 13927cdf-365c-465c-97b0-d3cc286910d9 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:57 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c96130-1fe7-415c-8f9d-64925b1d9d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:57 devstack sudo[103646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9 1073741824
Sep 12 21:06:57 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d45e22b-7652-4b68-b9e1-ef5b7f2aa24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 (dbf0eba5-31c1-415f-8f06-c7e99cb63ba8): created successfully
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d45e22b-7652-4b68-b9e1-ef5b7f2aa24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (781b3954-35f7-4db8-8079-17703daef20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-901a08e0-754b-4616-97b3-cbadc7970184 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created volume successfully.
Sep 12 21:06:58 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9 1073741824" returned: 0 in 0.454s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:58 devstack sudo[103652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9
Sep 12 21:06:58 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:58 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9" returned: 0 in 0.285s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1846687384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61642d49-b755-4ff1-b1d9-649c7ab7ee6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3bbc1db89e4dda82037f26d34a086e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:06:56Z,use_quota=True,user_id='7381eeff860f432682f04fe23b716fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Creating volume 61642d49-b755-4ff1-b1d9-649c7ab7ee6e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:06:58 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54fd5423-45c8-43cd-a8ab-d28b02e8d767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13927cdf-365c-465c-97b0-d3cc286910d9', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6d4f26-88cc-4896-8a02-c6a63a3f3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:58 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e 1073741824
Sep 12 21:06:58 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:58 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume volume-13927cdf-365c-465c-97b0-d3cc286910d9 (13927cdf-365c-465c-97b0-d3cc286910d9): created successfully
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6d4f26-88cc-4896-8a02-c6a63a3f3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:58 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (3eb01a13-e253-424f-a03f-13f111f0950a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-dde37c24-ef8e-4a80-a800-3a9fcd5a74e4 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created volume successfully.
Sep 12 21:06:59 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e 1073741824" returned: 0 in 0.473s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:59 devstack sudo[103661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e
Sep 12 21:06:59 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:06:59 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c3e32a-703d-469b-b333-3fb8d243154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8dfe02-94fa-4e1c-bca3-8b223b26d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:06:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Volume volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e (61642d49-b755-4ff1-b1d9-649c7ab7ee6e): created successfully
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8dfe02-94fa-4e1c-bca3-8b223b26d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Flow 'volume_create_manager' (b27a990d-e690-449d-8fe6-3b434c062213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:06:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d5b5dce4-4465-41e5-abd3-c89badf4ebf2 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created volume successfully.
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-61642d49-b755-4ff1-b1d9-649c7ab7ee6e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-61642d49-b755-4ff1-b1d9-649c7ab7ee6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-61642d49-b755-4ff1-b1d9-649c7ab7ee6e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-61642d49-b755-4ff1-b1d9-649c7ab7ee6e" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[38083d40-92f7-4ff7-a5ce-52161c0d0760]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:06:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:06:59 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e
Sep 12 21:06:59 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:00 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e" returned: 0 in 0.465s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:00 devstack sudo[103677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e
Sep 12 21:07:00 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:00 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-61642d49-b755-4ff1-b1d9-649c7ab7ee6e" returned: 0 in 0.297s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c5d4f3-abc3-493d-85ea-aed8fcc83c7c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-61642d49-b755-4ff1-b1d9-649c7ab7ee6e" released by "delete_volume" :: held 0.832s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['08857a08-314b-4ce8-a8c8-603c9211e1cb', '3208e03a-0dac-4915-a68c-8f3c316e644c', '228220ca-3450-45a3-a090-1ca6363e89eb', '41072f3f-496f-421b-8dc7-83b724d920ec'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:00 devstack sudo[103688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b
Sep 12 21:07:00 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:00 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:00 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-13927cdf-365c-465c-97b0-d3cc286910d9-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-13927cdf-365c-465c-97b0-d3cc286910d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-13927cdf-365c-465c-97b0-d3cc286910d9" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-13927cdf-365c-465c-97b0-d3cc286910d9" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5538d80b-1a14-4646-b1fb-882c82386d38]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:01 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" returned: 0 in 0.577s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.611s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:01 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.453s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleted volume successfully.
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '939ad987-1452-4ca8-aa35-20f2db6ef599', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:07:01 devstack sudo[103730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9
Sep 12 21:07:01 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb860749-ab4f-44dd-9435-c8407a52b397 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-61642d49-b755-4ff1-b1d9-649c7ab7ee6e-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-39dbc84d-8476-4e5d-8977-9683013d5118 req-43a4850e-45cd-4327-9bcb-559667923be8 tempest-TestInstancesWithCinderVolumes-1662807652 None] attachment_update completed successfully.
Sep 12 21:07:01 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9" returned: 0 in 0.567s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:01 devstack sudo[103739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9
Sep 12 21:07:01 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:01 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-13927cdf-365c-465c-97b0-d3cc286910d9" returned: 0 in 0.366s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-13927cdf-365c-465c-97b0-d3cc286910d9" released by "delete_volume" :: held 0.999s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['6f4c03f5-6a09-46e0-a36e-03aab57ef10d', 'be418180-89f7-4e08-8126-556fdaa0438f', '9679136e-516b-465e-b82a-8b7535159635', '5285ccb3-045f-4310-ae71-5d83043dc0dd'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:02 devstack sudo[103743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:02 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:02 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.252s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleted volume successfully.
Sep 12 21:07:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c7541295-dc2b-4b02-9aaa-f21ae581de7e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-13927cdf-365c-465c-97b0-d3cc286910d9-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f0121-e76a-46eb-aeef-6bc1fe1f8e4a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:03 devstack sudo[103755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8
Sep 12 21:07:03 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:03 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8" returned: 0 in 0.448s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:03 devstack sudo[103760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8
Sep 12 21:07:03 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:04 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8" returned: 0 in 0.373s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8" released by "delete_volume" :: held 0.885s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[382df36c-2162-4db1-885f-dbdd54039790]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['f5d82053-1c12-4b7c-8e39-20a46bd99847', '556532a4-f0c7-4276-bb2c-4cb1eb26ea4f', 'd9ae4a20-b9ca-44d9-b80e-136a0078a049', '05609373-6c3d-4f40-8337-9dd883594035'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:04 devstack sudo[103771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f
Sep 12 21:07:04 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:04 devstack sudo[103773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:04 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3" acquired by "delete_volume" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b809a3d-495d-4a7c-b603-342bf8330952]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:04 devstack sudo[103775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3
Sep 12 21:07:04 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:04 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f" returned: 0 in 0.626s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.647s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:04 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.525s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleted volume successfully.
Sep 12 21:07:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62851c26-625f-458f-b31b-5484717c7d10', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a4a6f0a8-b5cc-4309-9288-84194645a474 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-dbf0eba5-31c1-415f-8f06-c7e99cb63ba8-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-f0cf6f12-4f2d-4ec1-b71a-072ca4495742 req-5493c074-ca55-4619-bb50-080b260d2263 tempest-TestInstancesWithCinderVolumes-1662807652 None] attachment_update completed successfully.
Sep 12 21:07:05 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3" returned: 0 in 0.602s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:05 devstack sudo[103786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3
Sep 12 21:07:05 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:05 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3" returned: 0 in 0.328s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3" released by "delete_volume" :: held 0.995s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['87aa62f4-177a-4f5c-838e-93330d3fe104', 'b1c67d38-33de-40f8-8f46-2990a9ec0594', '91498406-952a-4601-aefd-8c341f8ee8e2', '6c4994ed-e478-44d1-8f48-48cd639be30d'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:05 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:05 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:06 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.340s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleted volume successfully.
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5ed38dd3-6836-43a4-ab9a-84eec46f51f9 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-5f47e33a-7536-4b80-8d2e-b2527e1b1fe3-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-ea12835c-f343-4d95-9fa5-5a72cc31e902-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-ea12835c-f343-4d95-9fa5-5a72cc31e902-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-ea12835c-f343-4d95-9fa5-5a72cc31e902" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-ea12835c-f343-4d95-9fa5-5a72cc31e902" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8d92a-f968-4561-8b9f-12de800dddab]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:07 devstack sudo[103800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902
Sep 12 21:07:07 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:07 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902" returned: 0 in 0.430s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:07 devstack sudo[103805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902
Sep 12 21:07:07 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:07 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ea12835c-f343-4d95-9fa5-5a72cc31e902" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-ea12835c-f343-4d95-9fa5-5a72cc31e902" released by "delete_volume" :: held 0.754s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['ee8fc467-c289-4bec-a44c-3fd6237026f8', '5216f868-0fff-4370-abed-56d65081a343', '4f9f73bb-95f7-4625-8a4c-ca66ce15a138', 'e327911d-b75c-49bc-a866-d5171336140e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:07 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:07 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-1254121e-8ae8-4e9d-a160-3f6daf3acbe9-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-1254121e-8ae8-4e9d-a160-3f6daf3acbe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-45309842-33c9-4a11-b96b-2397ae805442" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-45309842-33c9-4a11-b96b-2397ae805442" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-1254121e-8ae8-4e9d-a160-3f6daf3acbe9" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-1254121e-8ae8-4e9d-a160-3f6daf3acbe9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleting offline snapshot 1254121e-8ae8-4e9d-a160-3f6daf3acbe9 of volume 45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] snapshot_file for this snap is: volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a73b21-537e-4357-b9d4-1199f047a06b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:08 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleted volume successfully.
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d81c446b-dfb7-4743-aeef-dfb540ccb09e tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-ea12835c-f343-4d95-9fa5-5a72cc31e902-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:08 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9
Sep 12 21:07:08 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:08 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9" returned: 0 in 0.485s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45309842-33c9-4a11-b96b-2397ae805442(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e0f48c-0973-45bd-9fdf-781a47a98440]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:08 devstack sudo[103818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442
Sep 12 21:07:08 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:09 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442" returned: 0 in 0.446s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:09 devstack sudo[103829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9
Sep 12 21:07:09 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:09 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9" returned: 0 in 0.372s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:09 devstack sudo[103842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9
Sep 12 21:07:09 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Flow 'volume_create_manager' (21a10228-d294-49a7-9ec4-eac644f27745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f7b2a8-138f-41a2-9556-fa916469cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:09 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f7b2a8-138f-41a2-9556-fa916469cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1327271664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c151436f-d351-4fb9-8b6b-8be81d2b7088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16099cdf3a334b88a20206b408c36744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:07:10Z,use_quota=True,user_id='9012bc3085c7458c96625b2cb2144e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6a431a-3909-4a48-896e-9a1007cdd230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6a431a-3909-4a48-896e-9a1007cdd230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b53ae9c-2f5a-4364-a9a2-763f7d69414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b53ae9c-2f5a-4364-a9a2-763f7d69414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c151436f-d351-4fb9-8b6b-8be81d2b7088', 'volume_name': 'volume-c151436f-d351-4fb9-8b6b-8be81d2b7088', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456d304c-b441-41fc-b652-6f04c69a3957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456d304c-b441-41fc-b652-6f04c69a3957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b157ca3d-41b3-4c05-a7bb-e7a665003add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Volume c151436f-d351-4fb9-8b6b-8be81d2b7088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c151436f-d351-4fb9-8b6b-8be81d2b7088', 'volume_size': 1}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1327271664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c151436f-d351-4fb9-8b6b-8be81d2b7088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16099cdf3a334b88a20206b408c36744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:07:10Z,use_quota=True,user_id='9012bc3085c7458c96625b2cb2144e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Creating volume c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:07:09 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442.1254121e-8ae8-4e9d-a160-3f6daf3acbe9" returned: 0 in 0.341s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:09 devstack sudo[103849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 1073741824
Sep 12 21:07:09 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-1254121e-8ae8-4e9d-a160-3f6daf3acbe9" released by "_delete_snapshot" :: held 1.826s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-45309842-33c9-4a11-b96b-2397ae805442" released by "delete_snapshot" :: held 1.854s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['c67113fe-3125-402c-aa4e-44c992d0871c', '2d253b94-d1fb-41c6-9afa-a8a7b19c6dcb', 'c314197e-144e-4dd7-9d2e-056b16cb89b0', '7e39c60f-0922-4ab4-89d1-3e2b6d9d1cbe'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Delete snapshot completed successfully.
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce9ee742-655b-4d11-b6c0-df2f8a47efb1 tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-1254121e-8ae8-4e9d-a160-3f6daf3acbe9-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-45309842-33c9-4a11-b96b-2397ae805442-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-45309842-33c9-4a11-b96b-2397ae805442-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "cinder-quobyte-45309842-33c9-4a11-b96b-2397ae805442" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-45309842-33c9-4a11-b96b-2397ae805442" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe702ce-8b03-401d-a120-0caf3b24a243]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:10 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 1073741824" returned: 0 in 0.559s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:10 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442
Sep 12 21:07:10 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:10 devstack sudo[103859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:07:10 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-0fab91e8-9b12-4f0e-b5a9-e2cedc9f6368 req-81c1482e-1e11-49e4-bbfd-853291186bc9 tempest-TestInstancesWithCinderVolumes-1662807652 None] Terminate volume connection completed successfully.
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-0fab91e8-9b12-4f0e-b5a9-e2cedc9f6368 req-81c1482e-1e11-49e4-bbfd-853291186bc9 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deleting attachment 939ad987-1452-4ca8-aa35-20f2db6ef599. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:07:10 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:10 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442" returned: 0 in 0.414s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.308s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:10 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442
Sep 12 21:07:10 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b157ca3d-41b3-4c05-a7bb-e7a665003add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c151436f-d351-4fb9-8b6b-8be81d2b7088', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2171d39-d734-4355-a234-611d5d5a2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Volume volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 (c151436f-d351-4fb9-8b6b-8be81d2b7088): created successfully
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2171d39-d734-4355-a234-611d5d5a2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Flow 'volume_create_manager' (21a10228-d294-49a7-9ec4-eac644f27745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:07:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-63d146ef-83b0-42a3-b12c-622512434489 tempest-VolumesActionsTest-2119165144 None] Created volume successfully.
Sep 12 21:07:11 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-45309842-33c9-4a11-b96b-2397ae805442" returned: 0 in 0.252s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-quobyte-45309842-33c9-4a11-b96b-2397ae805442" released by "delete_volume" :: held 0.725s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Created reservations ['46f88e27-13fd-41bd-a756-4189dc585750', 'd524e91e-86fb-410b-bbac-7aa400d5dac7', '78dc6867-b41f-45f6-b63f-e240fa6d1920', 'e4309f11-5e84-48bf-99da-5bb5b5906848'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:11 devstack sudo[103868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:11 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "cinder-ced33c65-608f-4fe5-8fe1-fbbfde6a338b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-ced33c65-608f-4fe5-8fe1-fbbfde6a338b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "cinder-quobyte-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-quobyte-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d907a1-150e-433f-9de4-bd9ad777d64a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:11 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.273s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Deleted volume successfully.
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-db290ad4-48fe-48df-8cee-427b948ecf1f tempest-CreateVolumesFromSnapshotTest-346267570 None] Lock "cinder-45309842-33c9-4a11-b96b-2397ae805442-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:11 devstack sudo[103873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b
Sep 12 21:07:11 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:11 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" returned: 0 in 0.449s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:11 devstack sudo[103881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b
Sep 12 21:07:11 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:12 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" returned: 0 in 0.331s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-quobyte-ced33c65-608f-4fe5-8fe1-fbbfde6a338b" released by "delete_volume" :: held 0.845s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:12 devstack cinder-volume[87624]: WARNING cinder.quota [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13761033-608666813 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13761033-608666813, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:07:12 devstack cinder-volume[87624]: WARNING cinder.quota [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13761033-608666813 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-13761033-608666813, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Created reservations ['eaecbc43-5782-44d1-8584-593d483dbf24', '0dbb8c39-781f-44d6-9965-ada9d13a1024', '4c95e0b0-083f-466d-8e06-7863fb811591', 'a1d7e520-68a8-4e69-9f5a-6bc0fd2d979b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:12 devstack sudo[103884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:12 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:12 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.308s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deleted volume successfully.
Sep 12 21:07:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6ec741c8-6a80-4e06-ba41-e49cc2b737b4 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-ced33c65-608f-4fe5-8fe1-fbbfde6a338b-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Flow 'volume_create_manager' (fd61686f-73f3-4d1a-bba8-34499d7b8431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137edae9-d179-4adb-a645-8fc09affd007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137edae9-d179-4adb-a645-8fc09affd007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-927220899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4015c4a5-d76e-4504-b5bd-cca64047f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82989d0a532541cb85b38f435bb70938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:07:15Z,use_quota=True,user_id='acdf125a323b42639c04f237e4e395d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3cf0e9-bcdf-43c7-bdfa-76f26133fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3cf0e9-bcdf-43c7-bdfa-76f26133fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a462f53c-de96-4f55-b4fe-aef70ea8233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a462f53c-de96-4f55-b4fe-aef70ea8233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4015c4a5-d76e-4504-b5bd-cca64047f569', 'volume_name': 'volume-4015c4a5-d76e-4504-b5bd-cca64047f569', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac851c07-9405-4e34-b526-4dece09676df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac851c07-9405-4e34-b526-4dece09676df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892ee5ea-05f4-4e10-9c62-3eb48ad581f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Volume 4015c4a5-d76e-4504-b5bd-cca64047f569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4015c4a5-d76e-4504-b5bd-cca64047f569', 'volume_size': 1}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-927220899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4015c4a5-d76e-4504-b5bd-cca64047f569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82989d0a532541cb85b38f435bb70938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:07:15Z,use_quota=True,user_id='acdf125a323b42639c04f237e4e395d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Creating volume 4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:07:14 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:07:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:15 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 1073741824
Sep 12 21:07:15 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:15 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 1073741824" returned: 0 in 0.756s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-e43140cc-06a1-47bb-9645-554d6f823dbc req-04f63500-71e4-46f8-83af-0aabdb75ea03 tempest-TestInstancesWithCinderVolumes-1662807652 None] Terminate volume connection completed successfully.
Sep 12 21:07:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-e43140cc-06a1-47bb-9645-554d6f823dbc req-04f63500-71e4-46f8-83af-0aabdb75ea03 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deleting attachment 62851c26-625f-458f-b31b-5484717c7d10. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:07:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:15 devstack sudo[103937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:15 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:16 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892ee5ea-05f4-4e10-9c62-3eb48ad581f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4015c4a5-d76e-4504-b5bd-cca64047f569', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a3a897-b8d6-4875-a969-0d5d3a36bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Volume volume-4015c4a5-d76e-4504-b5bd-cca64047f569 (4015c4a5-d76e-4504-b5bd-cca64047f569): created successfully
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a3a897-b8d6-4875-a969-0d5d3a36bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Flow 'volume_create_manager' (fd61686f-73f3-4d1a-bba8-34499d7b8431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:07:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-92ff4d23-b870-4201-afc8-6c6fc2436f8f tempest-VolumeDependencyTests-1854366194 None] Created volume successfully.
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "cinder-c12afaa2-7208-4d39-9cf3-b41b4564c08f-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-c12afaa2-7208-4d39-9cf3-b41b4564c08f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "cinder-quobyte-c12afaa2-7208-4d39-9cf3-b41b4564c08f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-quobyte-c12afaa2-7208-4d39-9cf3-b41b4564c08f" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cb08d1-12f0-4047-ba69-8b9266ece697]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:16 devstack sudo[103940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f
Sep 12 21:07:16 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:16 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f" returned: 0 in 0.415s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:16 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f
Sep 12 21:07:16 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Creating offline snapshot da722a85-a5ef-4e3a-89ad-51fa330b5354 of volume 4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:07:17 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c12afaa2-7208-4d39-9cf3-b41b4564c08f" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-quobyte-c12afaa2-7208-4d39-9cf3-b41b4564c08f" released by "delete_volume" :: held 0.826s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece1119-c6a8-4448-a507-1a690b5d4361]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:17 devstack cinder-volume[87624]: WARNING cinder.quota [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2015696733-695282578 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2015696733-695282578, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:07:17 devstack cinder-volume[87624]: WARNING cinder.quota [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2015696733-695282578 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2015696733-695282578, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Created reservations ['c135cccf-9239-4b65-b1f2-533e8ee32c43', 'fdfc9adb-e48f-49b7-874f-bb49d509911a', '5316f3b3-dd13-41b9-bca0-8dba02ff24aa', '81462b60-e4e7-4d34-a6d5-a9b51453d4f1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:17 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:17 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:17 devstack sudo[103962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:17 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:17 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.637s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:18 devstack sudo[103994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 1G
Sep 12 21:07:18 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:18 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.563s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:18 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deleted volume successfully.
Sep 12 21:07:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-748614d9-a5c0-48a7-94df-c037b5dac4b8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-c12afaa2-7208-4d39-9cf3-b41b4564c08f-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:18 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 1G" returned: 0 in 0.823s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4015c4a5-d76e-4504-b5bd-cca64047f569 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:18 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4015c4a5-d76e-4504-b5bd-cca64047f569 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354
Sep 12 21:07:18 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:19 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4015c4a5-d76e-4504-b5bd-cca64047f569 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354" returned: 0 in 0.509s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:19 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 is being set with open permissions: ugo+rw
Sep 12 21:07:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:19 devstack sudo[104041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354
Sep 12 21:07:19 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:19 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354" returned: 0 in 0.372s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:19 devstack sudo[104047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info
Sep 12 21:07:19 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:20 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info" returned: 0 in 0.468s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:20 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info is being set with open permissions: ugo+rw
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:20 devstack sudo[104051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info
Sep 12 21:07:20 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79c58d16-4ea8-46ae-8106-9022e7ef3535 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088" by "attach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79c58d16-4ea8-46ae-8106-9022e7ef3535 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088" acquired by "attach_volume" :: waited 0.043s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:20 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.info" returned: 0 in 0.473s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.486s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-302dfbe5-032d-4128-9125-a2400c006158 tempest-VolumeDependencyTests-1854366194 None] Create snapshot completed successfully
Sep 12 21:07:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-79c58d16-4ea8-46ae-8106-9022e7ef3535 tempest-VolumesActionsTest-2119165144 None] Attaching volume c151436f-d351-4fb9-8b6b-8be81d2b7088 to instance adca175d-9aed-4e47-a12f-dbaf70ead95c at mountpoint /dev/vdb on host None.
Sep 12 21:07:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-79c58d16-4ea8-46ae-8106-9022e7ef3535 tempest-VolumesActionsTest-2119165144 None] Attach volume completed successfully.
Sep 12 21:07:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-79c58d16-4ea8-46ae-8106-9022e7ef3535 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088" released by "attach_volume" :: held 0.268s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0671cfba-66cd-4114-8b78-95c777feeee9 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-detach_volume" by "detach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0671cfba-66cd-4114-8b78-95c777feeee9 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-detach_volume" acquired by "detach_volume" :: waited 0.085s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0671cfba-66cd-4114-8b78-95c777feeee9 tempest-VolumesActionsTest-2119165144 None] Detaching volume c151436f-d351-4fb9-8b6b-8be81d2b7088 from instance adca175d-9aed-4e47-a12f-dbaf70ead95c.
Sep 12 21:07:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0671cfba-66cd-4114-8b78-95c777feeee9 tempest-VolumesActionsTest-2119165144 None] Detach volume completed successfully.
Sep 12 21:07:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0671cfba-66cd-4114-8b78-95c777feeee9 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:INSERT=38,cinder:UPDATE=168,cinder:SELECT=127,cinder:DELETE=11 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:07:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-2ba98db8-4e1d-44b0-831c-4092e82adcc0 req-844e6240-4fff-4673-9e1e-5a2b1cb189a8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Terminate volume connection completed successfully.
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-2ba98db8-4e1d-44b0-831c-4092e82adcc0 req-844e6240-4fff-4673-9e1e-5a2b1cb189a8 tempest-TestInstancesWithCinderVolumes-1662807652 None] Deleting attachment b2b28014-f15d-4f66-a2a3-02fbb781de2a. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Flow 'volume_create_manager' (9c7d845d-62dc-4b9b-9cdd-44412310d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70589cd6-559f-4007-a94b-5233f90b7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70589cd6-559f-4007-a94b-5233f90b7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-273562075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3810263f-f764-49b1-b128-3fdf61f9545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82989d0a532541cb85b38f435bb70938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da722a85-a5ef-4e3a-89ad-51fa330b5354,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:07:23Z,use_quota=True,user_id='acdf125a323b42639c04f237e4e395d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f2b27a-04a4-4808-9543-a5a8bc224237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f2b27a-04a4-4808-9543-a5a8bc224237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517abaac-9171-44af-84ce-8e15e3609235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517abaac-9171-44af-84ce-8e15e3609235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3810263f-f764-49b1-b128-3fdf61f9545b', 'volume_name': 'volume-3810263f-f764-49b1-b128-3fdf61f9545b', 'volume_size': 1, 'snapshot_id': 'da722a85-a5ef-4e3a-89ad-51fa330b5354'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070699d7-8fd3-45f8-89c1-743c6eb92a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070699d7-8fd3-45f8-89c1-743c6eb92a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe8503-9dd5-46ce-891a-8a17b92d01e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Volume 3810263f-f764-49b1-b128-3fdf61f9545b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3810263f-f764-49b1-b128-3fdf61f9545b', 'volume_size': 1, 'snapshot_id': 'da722a85-a5ef-4e3a-89ad-51fa330b5354'}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-quobyte-da722a85-a5ef-4e3a-89ad-51fa330b5354-3810263f-f764-49b1-b128-3fdf61f9545b" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-da722a85-a5ef-4e3a-89ad-51fa330b5354-3810263f-f764-49b1-b128-3fdf61f9545b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Creating volume 3810263f-f764-49b1-b128-3fdf61f9545b from snapshot da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-quobyte-3810263f-f764-49b1-b128-3fdf61f9545b" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-3810263f-f764-49b1-b128-3fdf61f9545b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] snapshot: da722a85-a5ef-4e3a-89ad-51fa330b5354, volume: 3810263f-f764-49b1-b128-3fdf61f9545b,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca0fbf8-3644-46d9-9ce4-f8f81a30f506]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:23 devstack sudo[104097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354
Sep 12 21:07:23 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:23 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354" returned: 0 in 0.539s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4015c4a5-d76e-4504-b5bd-cca64047f569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1370f440-19b1-4d4a-b2a4-4d57a161fa7c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:23 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:23 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "cinder-94570fb3-757c-4d95-b2ff-0628b57d1c05-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:24 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.426s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-94570fb3-757c-4d95-b2ff-0628b57d1c05-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:24 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b
Sep 12 21:07:24 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "cinder-quobyte-94570fb3-757c-4d95-b2ff-0628b57d1c05" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-quobyte-94570fb3-757c-4d95-b2ff-0628b57d1c05" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc0331-75e9-4c46-98b6-c394b3537dbc]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:24 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:07:24 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:24 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 0 in 0.596s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:25 devstack sudo[104125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:07:25 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:25 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 1 in 0.727s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:07:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:25 devstack sudo[104130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05
Sep 12 21:07:25 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:26 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-94570fb3-757c-4d95-b2ff-0628b57d1c05" returned: 0 in 0.791s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-quobyte-94570fb3-757c-4d95-b2ff-0628b57d1c05" released by "delete_volume" :: held 2.209s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:26 devstack cinder-volume[87624]: WARNING cinder.quota [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-934318109-1954683012 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-934318109-1954683012, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:07:26 devstack cinder-volume[87624]: WARNING cinder.quota [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-934318109-1954683012 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-934318109-1954683012, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Created reservations ['144cced2-c5c1-4c76-a93f-c21b3d39c5dd', 'b321ac08-e747-4cda-8d8b-399cee943c8a', '91beeb06-ab62-481b-9ff8-a376b1554bca', 'ace0d977-e0de-4ae3-8b71-d7e3269c64eb'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:26 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:26 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:27 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.631s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:27 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Deleted volume successfully.
Sep 12 21:07:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b9dae382-2eb7-4b94-a60a-649284bb033a tempest-TestInstancesWithCinderVolumes-1662807652 None] Lock "cinder-94570fb3-757c-4d95-b2ff-0628b57d1c05-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:30 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b" returned: 0 in 5.930s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343e93a-aee9-4f55-9674-486c613c73fb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:30 devstack sudo[104140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:30 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:30 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.658s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:07:30 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Converted 1024.00 MB image at 172.65 MB/s
Sep 12 21:07:30 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b is being set with open permissions: ugo+rw
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:30 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b
Sep 12 21:07:30 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:30 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b" returned: 0 in 0.305s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-3810263f-f764-49b1-b128-3fdf61f9545b" released by "_copy_volume_from_snapshot" :: held 8.024s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-da722a85-a5ef-4e3a-89ad-51fa330b5354-3810263f-f764-49b1-b128-3fdf61f9545b" released by "_create_volume_from_snapshot" :: held 8.068s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.091s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe8503-9dd5-46ce-891a-8a17b92d01e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3810263f-f764-49b1-b128-3fdf61f9545b', 'volume_size': 1, 'snapshot_id': 'da722a85-a5ef-4e3a-89ad-51fa330b5354'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fad060-707f-44b6-ac59-90d4325aa01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:07:31 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Volume volume-3810263f-f764-49b1-b128-3fdf61f9545b (3810263f-f764-49b1-b128-3fdf61f9545b): created successfully
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fad060-707f-44b6-ac59-90d4325aa01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Flow 'volume_create_manager' (9c7d845d-62dc-4b9b-9cdd-44412310d41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:07:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f0414f00-5660-481c-861a-2a28d2fefb2d tempest-VolumeDependencyTests-1854366194 None] Created volume successfully.
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-da722a85-a5ef-4e3a-89ad-51fa330b5354-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-da722a85-a5ef-4e3a-89ad-51fa330b5354-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-quobyte-4015c4a5-d76e-4504-b5bd-cca64047f569" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-4015c4a5-d76e-4504-b5bd-cca64047f569" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-quobyte-da722a85-a5ef-4e3a-89ad-51fa330b5354" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-da722a85-a5ef-4e3a-89ad-51fa330b5354" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Deleting offline snapshot da722a85-a5ef-4e3a-89ad-51fa330b5354 of volume 4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] snapshot_file for this snap is: volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c909da-2abd-4e69-a855-651e30dc7607]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:31 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354
Sep 12 21:07:31 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:32 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354" returned: 0 in 0.441s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4015c4a5-d76e-4504-b5bd-cca64047f569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:07:32 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b54d1b-297a-4b99-b24a-8a14caa94c64]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:32 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:32 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:32 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.416s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:32 devstack sudo[104179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354
Sep 12 21:07:32 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:33 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:33 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354
Sep 12 21:07:33 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:33 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569.da722a85-a5ef-4e3a-89ad-51fa330b5354" returned: 0 in 0.266s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:33 devstack sudo[104189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:33 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-da722a85-a5ef-4e3a-89ad-51fa330b5354" released by "_delete_snapshot" :: held 1.740s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-4015c4a5-d76e-4504-b5bd-cca64047f569" released by "delete_snapshot" :: held 1.788s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Created reservations ['b5e3bc45-71bd-40cd-a307-409548228a1e', 'b4b28d77-d1eb-4739-99b4-360e1cab13a8', 'a485a536-e40d-431a-a190-e474c08ba884', '9d40d981-d22d-4bb5-b8f3-1ed9e54e88cc'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:33 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Delete snapshot completed successfully.
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b14ecf4a-5757-4095-b2af-d514dd728b3c tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-da722a85-a5ef-4e3a-89ad-51fa330b5354-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:33 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.521s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-4015c4a5-d76e-4504-b5bd-cca64047f569-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-4015c4a5-d76e-4504-b5bd-cca64047f569-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-quobyte-4015c4a5-d76e-4504-b5bd-cca64047f569" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-4015c4a5-d76e-4504-b5bd-cca64047f569" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e95e41-2e3d-465e-a396-6a2cc5c95652]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:34 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:34 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:34 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.710s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:35 devstack sudo[104265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569
Sep 12 21:07:35 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:35 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4015c4a5-d76e-4504-b5bd-cca64047f569" returned: 0 in 0.385s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-4015c4a5-d76e-4504-b5bd-cca64047f569" released by "delete_volume" :: held 1.247s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Created reservations ['950d9ffb-6f5c-4779-a406-21c8bdb765fd', 'ef637f00-ad20-4baf-a2b2-dd557c6ba530', '7081fc97-40a4-45d0-8097-7c49a01f18b8', '723bf5f4-0685-4e87-ab0f-9e315f681ea4'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:35 devstack sudo[104271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:35 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:35 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:35 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Deleted volume successfully.
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d2a6ae01-d45c-4dc6-a655-be67ef06b2c7 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-4015c4a5-d76e-4504-b5bd-cca64047f569-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-401b0ed6-11b0-4af9-aafc-883e695f4fb1 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088" by "attach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-401b0ed6-11b0-4af9-aafc-883e695f4fb1 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088" acquired by "attach_volume" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-3810263f-f764-49b1-b128-3fdf61f9545b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-3810263f-f764-49b1-b128-3fdf61f9545b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-401b0ed6-11b0-4af9-aafc-883e695f4fb1 tempest-VolumesActionsTest-2119165144 None] Attaching volume c151436f-d351-4fb9-8b6b-8be81d2b7088 to instance dda7d6dd-ed10-4c37-afc3-5a973a47d046 at mountpoint /dev/vdb on host None.
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "cinder-quobyte-3810263f-f764-49b1-b128-3fdf61f9545b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-3810263f-f764-49b1-b128-3fdf61f9545b" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-401b0ed6-11b0-4af9-aafc-883e695f4fb1 tempest-VolumesActionsTest-2119165144 None] Attach volume completed successfully.
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-401b0ed6-11b0-4af9-aafc-883e695f4fb1 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088" released by "attach_volume" :: held 0.228s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa089a6-011a-4ce7-ba98-53b2ec291895]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:36 devstack sudo[104275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b
Sep 12 21:07:36 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f3cc83a-78f2-4d1f-b359-27c203696ea9 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-detach_volume" by "detach_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:07:37 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f3cc83a-78f2-4d1f-b359-27c203696ea9 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:07:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1f3cc83a-78f2-4d1f-b359-27c203696ea9 tempest-VolumesActionsTest-2119165144 None] Detaching volume c151436f-d351-4fb9-8b6b-8be81d2b7088 from instance dda7d6dd-ed10-4c37-afc3-5a973a47d046.
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b" returned: 0 in 0.551s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:37 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b
Sep 12 21:07:37 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1f3cc83a-78f2-4d1f-b359-27c203696ea9 tempest-VolumesActionsTest-2119165144 None] Detach volume completed successfully.
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1f3cc83a-78f2-4d1f-b359-27c203696ea9 tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-detach_volume" released by "detach_volume" :: held 0.189s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:37 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3810263f-f764-49b1-b128-3fdf61f9545b" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-quobyte-3810263f-f764-49b1-b128-3fdf61f9545b" released by "delete_volume" :: held 1.000s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Created reservations ['cb0edd51-e3af-4717-a131-e3ba3b1073f7', '7bf027b3-e42f-4985-bf1e-8a0eb2569853', '30ccd73e-2b73-4602-b629-9ab97db6123c', '600564ce-c625-47a5-8f4c-b4eed8bcd19e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:07:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:37 devstack sudo[104284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:07:37 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:38 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.289s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:38 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:07:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Deleted volume successfully.
Sep 12 21:07:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-70686a89-05aa-4aa8-858f-aecd12ac6fb6 tempest-VolumeDependencyTests-1854366194 None] Lock "cinder-3810263f-f764-49b1-b128-3fdf61f9545b-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:07:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:07:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:07:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb8b38-128b-4486-b6f2-d3985c2ce828]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:41 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:07:41 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:42 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.380s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:42 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2878ebec-7ee2-47a7-a59d-df4ef74fbe3c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:42 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:07:42 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:42 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.389s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.560efa37-83d3-4ea5-ae39-cefb593989d4lzoprx84.img {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:42 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.560efa37-83d3-4ea5-ae39-cefb593989d4lzoprx84.img
Sep 12 21:07:42 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:47 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.560efa37-83d3-4ea5-ae39-cefb593989d4lzoprx84.img" returned: 0 in 4.508s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf51f7-0547-4b65-8bfe-86d3a630bdcf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:07:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:07:47 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:07:47 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:07:47 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Sep 12 21:07:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.531s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:07:47 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.560efa37-83d3-4ea5-ae39-cefb593989d4lzoprx84.img {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:07:47 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Converted 1024.00 MB image at 227.09 MB/s
Sep 12 21:07:47 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] 560efa37-83d3-4ea5-ae39-cefb593989d4 was raw, no need to convert to raw {{(pid=87624) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Sep 12 21:07:48 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:07:53 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=122,cinder:UPDATE=141,cinder:INSERT=36,cinder:DELETE=13 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:08:03 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:08:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.995s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Uploaded volume to glance image-id: 560efa37-83d3-4ea5-ae39-cefb593989d4. {{(pid=87624) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 12 21:08:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2f9b8d35-9a03-44bc-bbca-27c05b2402a4 tempest-VolumesActionsTest-2119165144 None] Copy volume to image completed successfully.
Sep 12 21:08:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b9324-cf26-407b-9dd1-b5e7f668b3cb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:09 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:08:09 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:10 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.379s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e12f7a-0683-4667-8cb3-849b48cb6887]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:10 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:08:10 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:10 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.360s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:10 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img
Sep 12 21:08:10 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:14 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img" returned: 0 in 4.231s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d31ab3-ca12-41d9-805f-439898b561bf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:14 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:08:14 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:15 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.533s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:08:15 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Converted 1024.00 MB image at 241.86 MB/s
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] 97417f6a-5b71-4baa-876e-cafb287366c2 was raw, converting to qcow2 {{(pid=87624) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234462c-b27a-4f12-a503-9e3f0476399c]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:15 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img
Sep 12 21:08:15 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:15 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img" returned: 0 in 0.336s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:15 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img
Sep 12 21:08:15 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:16 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img" returned: 1 in 0.359s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_ {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:16 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_
Sep 12 21:08:16 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:16 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Image conversion details: src /opt/stack/data/cinder/conversion/c151436f-d351-4fb9-8b6b-8be81d2b7088.temp_image.97417f6a-5b71-4baa-876e-cafb287366c24z97vubl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_ {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:08:16 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f1484b-e12b-4a59-a455-0cec3acf6ebf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_ {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:16 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_
Sep 12 21:08:16 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:16 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xo93gnb_" returned: 0 in 0.477s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.663s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:18 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Uploaded volume to glance image-id: 97417f6a-5b71-4baa-876e-cafb287366c2. {{(pid=87624) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 12 21:08:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ec85ad61-3be4-4993-b323-ae09ea930dd7 tempest-VolumesActionsTest-2119165144 None] Copy volume to image completed successfully.
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Acquiring lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Acquiring lock "cinder-quobyte-c151436f-d351-4fb9-8b6b-8be81d2b7088" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Lock "cinder-quobyte-c151436f-d351-4fb9-8b6b-8be81d2b7088" acquired by "delete_volume" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be7da80-27eb-4954-8e4b-6a02d2b1e06e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:20 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:08:20 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:20 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.427s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:20 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088
Sep 12 21:08:20 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:20 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c151436f-d351-4fb9-8b6b-8be81d2b7088" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Lock "cinder-quobyte-c151436f-d351-4fb9-8b6b-8be81d2b7088" released by "delete_volume" :: held 0.732s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:20 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Created reservations ['0988f5ea-d94b-46ac-ad15-f884233d2e07', '368f30cc-2f64-4254-921f-a35e5103825a', 'a7672de9-793f-4f51-aa55-e2f380dc74da', '13bbc53e-47b3-4be8-bf48-70001d7eb3ca'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:21 devstack sudo[104562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:08:21 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:21 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:08:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Deleted volume successfully.
Sep 12 21:08:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2e3c729c-866b-477b-89f3-d5fee9db99ad tempest-VolumesActionsTest-2119165144 None] Lock "cinder-c151436f-d351-4fb9-8b6b-8be81d2b7088-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Flow 'volume_create_manager' (6bff2053-6d0c-43e8-89c4-57deab2c8162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b497e312-dc51-4edd-a111-8916419c1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b497e312-dc51-4edd-a111-8916419c1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1618119506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9693807e-52b9-4fba-8654-0fb31d1b0555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0736ce1f3e254be79cb04646ffa496c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:23Z,use_quota=True,user_id='2bdf2f6d09e44842a49b3ffacc9d9c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc67ac5b-1076-4c90-a8f6-865257a3f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc67ac5b-1076-4c90-a8f6-865257a3f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58f4420-783a-4ac8-b6de-8fe111b42681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58f4420-783a-4ac8-b6de-8fe111b42681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9693807e-52b9-4fba-8654-0fb31d1b0555', 'volume_name': 'volume-9693807e-52b9-4fba-8654-0fb31d1b0555', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d122325-3a11-45a7-b578-0925317be637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d122325-3a11-45a7-b578-0925317be637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c011b0c5-1759-45dc-a5af-bd27a7077ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Volume 9693807e-52b9-4fba-8654-0fb31d1b0555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9693807e-52b9-4fba-8654-0fb31d1b0555', 'volume_size': 1}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1618119506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9693807e-52b9-4fba-8654-0fb31d1b0555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0736ce1f3e254be79cb04646ffa496c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:23Z,use_quota=True,user_id='2bdf2f6d09e44842a49b3ffacc9d9c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Creating volume 9693807e-52b9-4fba-8654-0fb31d1b0555 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:08:22 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:08:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:22 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 1073741824
Sep 12 21:08:22 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:23 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 1073741824" returned: 0 in 0.483s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:23 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555
Sep 12 21:08:23 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:23 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555" returned: 0 in 0.310s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c011b0c5-1759-45dc-a5af-bd27a7077ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9693807e-52b9-4fba-8654-0fb31d1b0555', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535852ff-bd5c-4d7b-b07e-0c5a0dda0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:23 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Volume volume-9693807e-52b9-4fba-8654-0fb31d1b0555 (9693807e-52b9-4fba-8654-0fb31d1b0555): created successfully
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535852ff-bd5c-4d7b-b07e-0c5a0dda0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Flow 'volume_create_manager' (6bff2053-6d0c-43e8-89c4-57deab2c8162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:23 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-21497abc-a9f5-433f-a2c0-b3dae2a9e302 tempest-TestMinimumBasicScenario-1211654231 None] Created volume successfully.
Sep 12 21:08:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:25 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88991b0-0ee4-46b3-a1a8-5a96b737cdb7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:25 devstack sudo[104587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555
Sep 12 21:08:25 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:25 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555" returned: 0 in 0.394s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.488s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:26 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-9693807e-52b9-4fba-8654-0fb31d1b0555', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2ad1871-5dd6-46ba-9be5-5e035a9c40d3', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:08:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-2a558dea-2867-41e1-9655-e6f2bb244e2e req-56146809-b93f-4e71-a9e0-e785ab1edb14 tempest-TestMinimumBasicScenario-1211654231 None] attachment_update completed successfully.
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:33 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:08:33 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:33 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.330s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:08:36 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:08:36 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (b721946e-47fd-4abf-a7a4-37f81aa141ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd777ef-f5c7-40c2-aa2d-1fec11cf0a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd777ef-f5c7-40c2-aa2d-1fec11cf0a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1228849565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af321de6-5334-420f-900f-c3b0b85ee0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:40Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61bc7b1-51ca-417f-a262-1db7ffa858ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61bc7b1-51ca-417f-a262-1db7ffa858ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c00e18-f3bc-454b-8c5f-6cdf79ea7f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c00e18-f3bc-454b-8c5f-6cdf79ea7f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af321de6-5334-420f-900f-c3b0b85ee0b5', 'volume_name': 'volume-af321de6-5334-420f-900f-c3b0b85ee0b5', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb66fa5a-9eb4-4b1c-a8f2-79946d7cb85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb66fa5a-9eb4-4b1c-a8f2-79946d7cb85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c07a90-574b-4b18-be17-0dd83ed05d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Volume af321de6-5334-420f-900f-c3b0b85ee0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af321de6-5334-420f-900f-c3b0b85ee0b5', 'volume_size': 1}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1228849565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af321de6-5334-420f-900f-c3b0b85ee0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:40Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Creating volume af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:08:39 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:08:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:39 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 1073741824
Sep 12 21:08:39 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:40 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 1073741824" returned: 0 in 0.467s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:40 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5
Sep 12 21:08:40 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:40 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c07a90-574b-4b18-be17-0dd83ed05d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af321de6-5334-420f-900f-c3b0b85ee0b5', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120677eb-6e86-49d5-8983-5b02e7808673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Volume volume-af321de6-5334-420f-900f-c3b0b85ee0b5 (af321de6-5334-420f-900f-c3b0b85ee0b5): created successfully
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120677eb-6e86-49d5-8983-5b02e7808673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (b721946e-47fd-4abf-a7a4-37f81aa141ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-82f5a64f-ca09-4e24-94a1-d0f6b4903f6c tempest-VolumesSnapshotTestJSON-1555368495 None] Created volume successfully.
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Creating offline snapshot e22a4b03-cc1a-4a80-9068-a96366b09686 of volume af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ab685-0d4a-4cef-bab2-eaa214e90034]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:41 devstack sudo[105017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5
Sep 12 21:08:41 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:41 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5" returned: 0 in 0.360s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:41 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 1G
Sep 12 21:08:41 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:41 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 1G" returned: 0 in 0.378s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af321de6-5334-420f-900f-c3b0b85ee0b5 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:41 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af321de6-5334-420f-900f-c3b0b85ee0b5 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686
Sep 12 21:08:41 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:42 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af321de6-5334-420f-900f-c3b0b85ee0b5 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:42 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 is being set with open permissions: ugo+rw
Sep 12 21:08:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:42 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686
Sep 12 21:08:42 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:42 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686" returned: 0 in 0.337s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:42 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info
Sep 12 21:08:42 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:42 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info" returned: 0 in 0.257s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:42 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info is being set with open permissions: ugo+rw
Sep 12 21:08:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:42 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info
Sep 12 21:08:42 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:43 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.info" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-41c1ac48-7229-4650-ad1c-be2868ff28cb tempest-VolumesSnapshotTestJSON-1555368495 None] Create snapshot completed successfully
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-e22a4b03-cc1a-4a80-9068-a96366b09686-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-e22a4b03-cc1a-4a80-9068-a96366b09686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-af321de6-5334-420f-900f-c3b0b85ee0b5" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-af321de6-5334-420f-900f-c3b0b85ee0b5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-e22a4b03-cc1a-4a80-9068-a96366b09686" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-e22a4b03-cc1a-4a80-9068-a96366b09686" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Deleting offline snapshot e22a4b03-cc1a-4a80-9068-a96366b09686 of volume af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] snapshot_file for this snap is: volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026de1c-5619-465a-b646-e6cf2acfca7b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:44 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686
Sep 12 21:08:44 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:44 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af321de6-5334-420f-900f-c3b0b85ee0b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3918028c-0397-4f01-a794-094d81771272]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:45 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5
Sep 12 21:08:45 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:45 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5" returned: 0 in 0.384s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:45 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686
Sep 12 21:08:45 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:45 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:45 devstack sudo[105065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686
Sep 12 21:08:45 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:45 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5.e22a4b03-cc1a-4a80-9068-a96366b09686" returned: 0 in 0.250s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-e22a4b03-cc1a-4a80-9068-a96366b09686" released by "_delete_snapshot" :: held 1.422s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-af321de6-5334-420f-900f-c3b0b85ee0b5" released by "delete_snapshot" :: held 1.441s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:45 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['ef3ee41d-f127-4379-b3d2-4f15519a3c4b', 'adc0a2bf-9620-4b7e-a084-8ccebe5d9347', 'ae5af97b-3e90-4e28-b8d2-c3eb69d9b87b', '9001edff-c4e3-4ff3-b17d-bfdc94f1c2bd'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:08:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Delete snapshot completed successfully.
Sep 12 21:08:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f22d1c8-f8d9-45c5-88a2-16c692c6c206 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-e22a4b03-cc1a-4a80-9068-a96366b09686-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (24d38f31-c448-4ee9-a467-3f41ed16f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a07d32d-c7dd-4331-87f5-a4fc01bbbac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a07d32d-c7dd-4331-87f5-a4fc01bbbac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2055233431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded8b938-babd-48ce-b073-c32e25569695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:47Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e836091a-6520-40e7-a478-fc1405c3eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e836091a-6520-40e7-a478-fc1405c3eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc21eb80-ea9e-4f0a-a89c-dc6b4bce6dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc21eb80-ea9e-4f0a-a89c-dc6b4bce6dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded8b938-babd-48ce-b073-c32e25569695', 'volume_name': 'volume-ded8b938-babd-48ce-b073-c32e25569695', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda77b9a-cb47-4a11-bfd1-405446695722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda77b9a-cb47-4a11-bfd1-405446695722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6a484c-4ef0-4006-a2ac-f6e6baa2065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:47 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Volume ded8b938-babd-48ce-b073-c32e25569695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded8b938-babd-48ce-b073-c32e25569695', 'volume_size': 1}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2055233431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded8b938-babd-48ce-b073-c32e25569695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:47Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Creating volume ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:08:47 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:47 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 1073741824
Sep 12 21:08:47 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:47 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 1073741824" returned: 0 in 0.511s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:47 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:08:47 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:47 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.253s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6a484c-4ef0-4006-a2ac-f6e6baa2065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded8b938-babd-48ce-b073-c32e25569695', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb80ebb7-5cab-4741-bcf8-98506404ffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:48 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Volume volume-ded8b938-babd-48ce-b073-c32e25569695 (ded8b938-babd-48ce-b073-c32e25569695): created successfully
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb80ebb7-5cab-4741-bcf8-98506404ffcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (24d38f31-c448-4ee9-a467-3f41ed16f923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0b29bfba-273b-46cf-8755-8970aa1ff67b tempest-VolumesSnapshotTestJSON-1555368495 None] Created volume successfully.
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Creating offline snapshot bd27ced7-49c1-4039-9e12-25806d698c78 of volume ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e7621-10b1-4fc4-8579-511416703ee7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:49 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:08:49 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:49 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:49 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 1G
Sep 12 21:08:49 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:50 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 1G" returned: 0 in 0.384s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded8b938-babd-48ce-b073-c32e25569695 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:50 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded8b938-babd-48ce-b073-c32e25569695 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78
Sep 12 21:08:50 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:50 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded8b938-babd-48ce-b073-c32e25569695 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:50 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 is being set with open permissions: ugo+rw
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:50 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78
Sep 12 21:08:50 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:50 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78" returned: 0 in 0.244s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:50 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info
Sep 12 21:08:50 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:50 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:50 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info is being set with open permissions: ugo+rw
Sep 12 21:08:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:50 devstack sudo[105146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info
Sep 12 21:08:50 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:51 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.info" returned: 0 in 0.239s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2b368c4b-9b3f-456c-abdb-57a7f000bee2 tempest-VolumesSnapshotTestJSON-1555368495 None] Create snapshot completed successfully
Sep 12 21:08:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (b313fc9d-fc91-4c71-8283-6cadb6b6a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac6c944-4656-4f5c-b0fd-43763c0e4f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac6c944-4656-4f5c-b0fd-43763c0e4f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-944790195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772ebf55-ed27-4368-9ba9-ac0af828ab58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:08:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bd27ced7-49c1-4039-9e12-25806d698c78,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:08:52Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6da2cdf-eb39-4471-8b0e-5e23e34bda42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6da2cdf-eb39-4471-8b0e-5e23e34bda42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2f7922-0256-4951-b390-dbc2cb3ad893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2f7922-0256-4951-b390-dbc2cb3ad893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '772ebf55-ed27-4368-9ba9-ac0af828ab58', 'volume_name': 'volume-772ebf55-ed27-4368-9ba9-ac0af828ab58', 'volume_size': 2, 'snapshot_id': 'bd27ced7-49c1-4039-9e12-25806d698c78'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecafce4-596d-4a7f-9e9f-dddbd949c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecafce4-596d-4a7f-9e9f-dddbd949c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed4f08b-0865-4b45-a675-202e12c305a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Volume 772ebf55-ed27-4368-9ba9-ac0af828ab58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-772ebf55-ed27-4368-9ba9-ac0af828ab58', 'volume_size': 2, 'snapshot_id': 'bd27ced7-49c1-4039-9e12-25806d698c78'}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-bd27ced7-49c1-4039-9e12-25806d698c78-772ebf55-ed27-4368-9ba9-ac0af828ab58" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-bd27ced7-49c1-4039-9e12-25806d698c78-772ebf55-ed27-4368-9ba9-ac0af828ab58" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Creating volume 772ebf55-ed27-4368-9ba9-ac0af828ab58 from snapshot bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-772ebf55-ed27-4368-9ba9-ac0af828ab58" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-772ebf55-ed27-4368-9ba9-ac0af828ab58" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] snapshot: bd27ced7-49c1-4039-9e12-25806d698c78, volume: 772ebf55-ed27-4368-9ba9-ac0af828ab58,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a376f127-2f9b-469d-ae5c-727759953e58]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:52 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78
Sep 12 21:08:52 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:52 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded8b938-babd-48ce-b073-c32e25569695(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f64e3-4aaa-4c72-a691-db850cba10ad]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:52 devstack sudo[105157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:08:52 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:52 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:08:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:52 devstack sudo[105162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58
Sep 12 21:08:52 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58" returned: 0 in 5.480s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:58 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a554fd2-51ae-4bf3-a51b-065a44243de2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:58 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:08:58 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:58 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.557s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:58 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:08:58 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Converted 1024.00 MB image at 186.80 MB/s
Sep 12 21:08:58 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 is being set with open permissions: ugo+rw
Sep 12 21:08:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:59 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58
Sep 12 21:08:59 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:08:59 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58" returned: 0 in 0.232s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-772ebf55-ed27-4368-9ba9-ac0af828ab58" released by "_copy_volume_from_snapshot" :: held 7.100s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-bd27ced7-49c1-4039-9e12-25806d698c78-772ebf55-ed27-4368-9ba9-ac0af828ab58" released by "_create_volume_from_snapshot" :: held 7.143s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.164s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed4f08b-0865-4b45-a675-202e12c305a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772ebf55-ed27-4368-9ba9-ac0af828ab58', 'volume_size': 2, 'snapshot_id': 'bd27ced7-49c1-4039-9e12-25806d698c78'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63526c5-8dc2-404c-a529-7da83ed88657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:08:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Volume volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 (772ebf55-ed27-4368-9ba9-ac0af828ab58): created successfully
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63526c5-8dc2-404c-a529-7da83ed88657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (b313fc9d-fc91-4c71-8283-6cadb6b6a28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:08:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ed8c42a8-9dde-4e55-85e4-bd4befcebea3 tempest-VolumesSnapshotTestJSON-1555368495 None] Created volume successfully.
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-772ebf55-ed27-4368-9ba9-ac0af828ab58-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-772ebf55-ed27-4368-9ba9-ac0af828ab58-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-772ebf55-ed27-4368-9ba9-ac0af828ab58" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-772ebf55-ed27-4368-9ba9-ac0af828ab58" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b031a-2a0c-4dd5-a781-354739b2d8bc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:08:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:08:59 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58
Sep 12 21:08:59 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:00 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58" returned: 0 in 0.402s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:00 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58
Sep 12 21:09:00 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:00 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-772ebf55-ed27-4368-9ba9-ac0af828ab58" returned: 0 in 0.243s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-772ebf55-ed27-4368-9ba9-ac0af828ab58" released by "delete_volume" :: held 0.684s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['a4eb2879-a24f-443d-ba1d-b01d0939d75f', 'acc8dca9-b9ee-451d-b494-12fd1afc65a1', 'e537a13d-c57b-4350-8c84-794766ca01ba', '571308c8-b4c4-4cb0-adfe-77508b69543f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:00 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:00 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:00 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.239s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Deleted volume successfully.
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c48ca1bf-24eb-4e9a-89e6-49e7d05c9edb tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-772ebf55-ed27-4368-9ba9-ac0af828ab58-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-bd27ced7-49c1-4039-9e12-25806d698c78-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-bd27ced7-49c1-4039-9e12-25806d698c78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-ded8b938-babd-48ce-b073-c32e25569695" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-ded8b938-babd-48ce-b073-c32e25569695" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-bd27ced7-49c1-4039-9e12-25806d698c78" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-bd27ced7-49c1-4039-9e12-25806d698c78" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Deleting offline snapshot bd27ced7-49c1-4039-9e12-25806d698c78 of volume ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] snapshot_file for this snap is: volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae386300-bf32-4e14-aa97-ceba2f48fdd1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:01 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78
Sep 12 21:09:01 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:01 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78" returned: 0 in 0.350s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded8b938-babd-48ce-b073-c32e25569695(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ca7144-2b1c-449e-b28f-2120dcf61527]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:01 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:09:01 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:01 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.350s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:01 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78
Sep 12 21:09:01 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:02 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:02 devstack sudo[105228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78
Sep 12 21:09:02 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:02 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695.bd27ced7-49c1-4039-9e12-25806d698c78" returned: 0 in 0.247s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-bd27ced7-49c1-4039-9e12-25806d698c78" released by "_delete_snapshot" :: held 1.374s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-ded8b938-babd-48ce-b073-c32e25569695" released by "delete_snapshot" :: held 1.394s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['f2c60cd0-9036-458b-8f8a-536e0f574cde', '976e0029-f5d3-441e-8e5b-4e00503dbbab', 'e3388635-ed1b-4944-9017-2ba9a90bf304', '929ba7c9-f5ed-4c06-9b18-0ce2f8c6bce4'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Delete snapshot completed successfully.
Sep 12 21:09:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543bafd6-4ff4-40e3-90fc-e030f29cde5d tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-bd27ced7-49c1-4039-9e12-25806d698c78-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-ded8b938-babd-48ce-b073-c32e25569695-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-ded8b938-babd-48ce-b073-c32e25569695-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-ded8b938-babd-48ce-b073-c32e25569695" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-ded8b938-babd-48ce-b073-c32e25569695" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[86028456-9a27-4e81-9456-1ea55b929590]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:03 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:09:03 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:03 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.349s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:03 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695
Sep 12 21:09:03 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:03 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ded8b938-babd-48ce-b073-c32e25569695" returned: 0 in 0.238s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-ded8b938-babd-48ce-b073-c32e25569695" released by "delete_volume" :: held 0.640s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:03 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['423cf24b-1786-4954-add6-58b55c4938f3', 'cb1f27cd-3c3d-43c0-b3a7-25bce804ff64', 'fc7ab931-7e2a-4ac3-b863-bc3537a02fbb', '32a9fb1d-96d3-4d45-8521-977008700ef1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:04 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:04 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:04 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.252s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Deleted volume successfully.
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-af7c1956-47d2-475f-adef-eba85081b92f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-ded8b938-babd-48ce-b073-c32e25569695-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (ef9f83e8-2f7a-4492-bab4-f273ceb6ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5969a240-f801-4aef-a740-93ef56ea5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5969a240-f801-4aef-a740-93ef56ea5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-435123071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f203eb6c-bd59-4f2b-9821-0fcad6af20b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:09:05Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bdc64b-0b0c-4c14-8051-85dfd4fad0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bdc64b-0b0c-4c14-8051-85dfd4fad0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcd16c7-fd44-4e4e-aed0-9ba98a2fab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcd16c7-fd44-4e4e-aed0-9ba98a2fab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f203eb6c-bd59-4f2b-9821-0fcad6af20b1', 'volume_name': 'volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce6cf3d-3419-46b2-a4f1-50a614b1cc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce6cf3d-3419-46b2-a4f1-50a614b1cc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e05d12-9d50-4b03-8486-a3a397a2d46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Volume f203eb6c-bd59-4f2b-9821-0fcad6af20b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1', 'volume_size': 1}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-435123071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f203eb6c-bd59-4f2b-9821-0fcad6af20b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:09:05Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Creating volume f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:09:04 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:09:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:04 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 1073741824
Sep 12 21:09:04 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:05 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 1073741824" returned: 0 in 0.404s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:05 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:05 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:05 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.255s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e05d12-9d50-4b03-8486-a3a397a2d46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466289ac-20f3-4f70-81a8-55914c00dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:05 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Volume volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 (f203eb6c-bd59-4f2b-9821-0fcad6af20b1): created successfully
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466289ac-20f3-4f70-81a8-55914c00dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (ef9f83e8-2f7a-4492-bab4-f273ceb6ac21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:09:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e831d5e4-c3e0-4b7d-8e2e-fd66e7f99636 tempest-VolumesSnapshotTestJSON-1555368495 None] Created volume successfully.
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Creating offline snapshot 5fad189a-0427-4c3d-b2d9-d2a282c1bd47 of volume f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:09:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74e347-c20b-4ac6-a3c7-b88b0c55775b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:06 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:06 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:06 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.389s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:06 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 1G
Sep 12 21:09:06 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:06 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 1G" returned: 0 in 0.396s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:06 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47
Sep 12 21:09:06 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:07 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47" returned: 0 in 0.295s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:07 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 is being set with open permissions: ugo+rw
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:07 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47
Sep 12 21:09:07 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:07 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47" returned: 0 in 0.271s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:07 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info
Sep 12 21:09:07 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:07 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info" returned: 0 in 0.244s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:07 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info is being set with open permissions: ugo+rw
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:07 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info
Sep 12 21:09:07 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:07 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.info" returned: 0 in 0.236s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:07 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0cdce392-e394-41f6-85a4-94bfbb1aaa8f tempest-VolumesSnapshotTestJSON-1555368495 None] Create snapshot completed successfully
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (87b6325c-163e-443e-91cc-2cc315d0044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e66a1ab-de86-4db1-8b17-58ac4d656c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e66a1ab-de86-4db1-8b17-58ac4d656c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-73314095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464b4a3d-947e-4aa9-8ccc-d492a4577c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579e6b5277ab480a845fadee0f5a92c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fad189a-0427-4c3d-b2d9-d2a282c1bd47,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:09:09Z,use_quota=True,user_id='f0896c8b507f459e806bd9c3a89644df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e233b686-ffb8-4aff-b0bb-eda60fcf7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e233b686-ffb8-4aff-b0bb-eda60fcf7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6b316d-3f15-4329-b8f6-80be13d6eb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6b316d-3f15-4329-b8f6-80be13d6eb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '464b4a3d-947e-4aa9-8ccc-d492a4577c54', 'volume_name': 'volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54', 'volume_size': 1, 'snapshot_id': '5fad189a-0427-4c3d-b2d9-d2a282c1bd47'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0595491-dd21-4c4d-b193-bc1dece12f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0595491-dd21-4c4d-b193-bc1dece12f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefc7988-efe2-46aa-8918-70787ed42831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Volume 464b4a3d-947e-4aa9-8ccc-d492a4577c54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54', 'volume_size': 1, 'snapshot_id': '5fad189a-0427-4c3d-b2d9-d2a282c1bd47'}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-5fad189a-0427-4c3d-b2d9-d2a282c1bd47-464b4a3d-947e-4aa9-8ccc-d492a4577c54" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-5fad189a-0427-4c3d-b2d9-d2a282c1bd47-464b4a3d-947e-4aa9-8ccc-d492a4577c54" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Creating volume 464b4a3d-947e-4aa9-8ccc-d492a4577c54 from snapshot 5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-464b4a3d-947e-4aa9-8ccc-d492a4577c54" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-464b4a3d-947e-4aa9-8ccc-d492a4577c54" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] snapshot: 5fad189a-0427-4c3d-b2d9-d2a282c1bd47, volume: 464b4a3d-947e-4aa9-8ccc-d492a4577c54,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[df622ecc-85e2-4ed4-869f-5eeb8c795cdf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:08 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47
Sep 12 21:09:08 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:09 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47" returned: 0 in 0.371s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49eea3-c062-4620-a438-d2b59d4cb07e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:09 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:09 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:09 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.419s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:09:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:09 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54
Sep 12 21:09:09 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-374e96b9-5906-45e6-8653-1237378b8c50 req-41b2efac-762f-4ed1-917c-dcc81f7f1f9e tempest-TestMinimumBasicScenario-1211654231 None] Terminate volume connection completed successfully.
Sep 12 21:09:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-374e96b9-5906-45e6-8653-1237378b8c50 req-41b2efac-762f-4ed1-917c-dcc81f7f1f9e tempest-TestMinimumBasicScenario-1211654231 None] Deleting attachment e2ad1871-5dd6-46ba-9be5-5e035a9c40d3. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:09:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Acquiring lock "cinder-9693807e-52b9-4fba-8654-0fb31d1b0555-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Lock "cinder-9693807e-52b9-4fba-8654-0fb31d1b0555-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Acquiring lock "cinder-quobyte-9693807e-52b9-4fba-8654-0fb31d1b0555" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Lock "cinder-quobyte-9693807e-52b9-4fba-8654-0fb31d1b0555" acquired by "delete_volume" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c24f83-b701-4524-be0d-04e8962159d4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:14 devstack sudo[105349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555
Sep 12 21:09:14 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:14 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555" returned: 0 in 0.601s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:14 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555
Sep 12 21:09:14 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:14 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54" returned: 0 in 5.051s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cddd35-8a6a-455b-8f35-d1aa6993e089]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:14 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:14 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:14 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-9693807e-52b9-4fba-8654-0fb31d1b0555" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Lock "cinder-quobyte-9693807e-52b9-4fba-8654-0fb31d1b0555" released by "delete_volume" :: held 0.990s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Created reservations ['061e72c2-5e13-45f3-abae-c3aec28f114a', 'ccb07556-167c-4540-9801-25929723d068', '2fcfe741-6d79-4369-81e6-cf31b2f05dd6', 'a738e6ae-fafd-474c-9c5f-4090d5cdee80'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:15 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:15 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:15 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.552s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:09:15 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Converted 1024.00 MB image at 202.66 MB/s
Sep 12 21:09:15 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 is being set with open permissions: ugo+rw
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:15 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54
Sep 12 21:09:15 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:15 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.267s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Deleted volume successfully.
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-543fa59e-30bd-49cd-9573-638bc191e088 tempest-TestMinimumBasicScenario-1211654231 None] Lock "cinder-9693807e-52b9-4fba-8654-0fb31d1b0555-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:15 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54" returned: 0 in 0.241s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-464b4a3d-947e-4aa9-8ccc-d492a4577c54" released by "_copy_volume_from_snapshot" :: held 6.727s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-5fad189a-0427-4c3d-b2d9-d2a282c1bd47-464b4a3d-947e-4aa9-8ccc-d492a4577c54" released by "_create_volume_from_snapshot" :: held 6.762s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.779s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefc7988-efe2-46aa-8918-70787ed42831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54', 'volume_size': 1, 'snapshot_id': '5fad189a-0427-4c3d-b2d9-d2a282c1bd47'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0babfc04-74cd-437e-94cc-bd76cc11a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Volume volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 (464b4a3d-947e-4aa9-8ccc-d492a4577c54): created successfully
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0babfc04-74cd-437e-94cc-bd76cc11a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Flow 'volume_create_manager' (87b6325c-163e-443e-91cc-2cc315d0044d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:09:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-464b655c-e95a-43f0-9faa-b0e1052bf61f tempest-VolumesSnapshotTestJSON-1555368495 None] Created volume successfully.
Sep 12 21:09:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-464b4a3d-947e-4aa9-8ccc-d492a4577c54-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-464b4a3d-947e-4aa9-8ccc-d492a4577c54-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-464b4a3d-947e-4aa9-8ccc-d492a4577c54" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-464b4a3d-947e-4aa9-8ccc-d492a4577c54" acquired by "delete_volume" :: waited 0.041s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846d049-e450-4017-87f1-99f80721d93d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:16 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54
Sep 12 21:09:16 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:17 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54" returned: 0 in 0.427s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:17 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54
Sep 12 21:09:17 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:17 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-464b4a3d-947e-4aa9-8ccc-d492a4577c54" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-464b4a3d-947e-4aa9-8ccc-d492a4577c54" released by "delete_volume" :: held 0.780s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['ef9c08c0-c6b3-4422-bca5-6870c5f228e7', 'e3fdb8ac-3600-4692-8a53-4ccb35939c9f', '615ced07-6d1a-42c5-9a97-ce5fd155ee4a', 'f44c93c2-2ccf-4af8-8f59-10bd49ddc651'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:17 devstack sudo[105403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:17 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-5fad189a-0427-4c3d-b2d9-d2a282c1bd47-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-5fad189a-0427-4c3d-b2d9-d2a282c1bd47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-5fad189a-0427-4c3d-b2d9-d2a282c1bd47" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-5fad189a-0427-4c3d-b2d9-d2a282c1bd47" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:17 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Deleting offline snapshot 5fad189a-0427-4c3d-b2d9-d2a282c1bd47 of volume f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] snapshot_file for this snap is: volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.306s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Deleted volume successfully.
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a60db-df0c-4ede-94bf-6b8cb9faf688]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7025e4a0-94c0-4759-8a40-3c030a3da2aa tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-464b4a3d-947e-4aa9-8ccc-d492a4577c54-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:17 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47
Sep 12 21:09:17 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:18 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47" returned: 0 in 0.362s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c2117-6eda-4642-a02a-a18e202c0a06]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:18 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:18 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:18 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.354s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:18 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47
Sep 12 21:09:18 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:18 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47" returned: 0 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:18 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47
Sep 12 21:09:18 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:19 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1.5fad189a-0427-4c3d-b2d9-d2a282c1bd47" returned: 0 in 0.274s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-5fad189a-0427-4c3d-b2d9-d2a282c1bd47" released by "_delete_snapshot" :: held 1.446s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" released by "delete_snapshot" :: held 1.474s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['aa480a9b-ef03-42c9-9157-7636f42d805a', '3c1a3b2a-d30a-4a84-9cfc-e390dd23039c', '408956e2-f677-4ead-8479-076b8b77f485', 'a6dfc02a-60b9-4192-bdc0-638cf364d3cc'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Delete snapshot completed successfully.
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ae859d51-0618-49f1-8d61-c948bc7fcf47 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-5fad189a-0427-4c3d-b2d9-d2a282c1bd47-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-f203eb6c-bd59-4f2b-9821-0fcad6af20b1-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-f203eb6c-bd59-4f2b-9821-0fcad6af20b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[75146e21-1e2a-425d-94c9-ec3105977cd1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:20 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:20 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:20 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.365s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:20 devstack sudo[105436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1
Sep 12 21:09:20 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:20 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-f203eb6c-bd59-4f2b-9821-0fcad6af20b1" released by "delete_volume" :: held 0.676s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['68128a23-6ead-4860-86d0-459808a414f6', 'faafabd3-77f6-4d77-a34a-0684bb43f4ef', '98fad10f-bd38-40df-bb32-bed7ebd49004', 'c89d3036-e042-4632-b6b8-44443190a28c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:20 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:20 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:21 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Deleted volume successfully.
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-754a76cb-f2a2-41e8-b532-a1d19ac9a118 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-f203eb6c-bd59-4f2b-9821-0fcad6af20b1-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-af321de6-5334-420f-900f-c3b0b85ee0b5-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-af321de6-5334-420f-900f-c3b0b85ee0b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "cinder-quobyte-af321de6-5334-420f-900f-c3b0b85ee0b5" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-af321de6-5334-420f-900f-c3b0b85ee0b5" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[010116d3-005a-4bba-b4f5-3aadc7d174fe]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:21 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5
Sep 12 21:09:21 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:21 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:21 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5
Sep 12 21:09:21 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:21 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-af321de6-5334-420f-900f-c3b0b85ee0b5" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-quobyte-af321de6-5334-420f-900f-c3b0b85ee0b5" released by "delete_volume" :: held 0.704s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:21 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Created reservations ['38d93f9c-f6f5-425c-a31f-215dc1401030', 'ffb50fa3-04c8-4c48-a8e0-b177a06466d9', 'c2c4e4b6-cc73-46db-84a3-738ebc9a55b2', '22881678-351a-4244-b2cd-439dfcd872e1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:22 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:22 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:22 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.248s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Deleted volume successfully.
Sep 12 21:09:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f6f8859-99a8-4e6e-acca-1abeb5cdf9b1 tempest-VolumesSnapshotTestJSON-1555368495 None] Lock "cinder-af321de6-5334-420f-900f-c3b0b85ee0b5-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:09:32 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=84,cinder:SELECT=73,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:09:32 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=77,cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:33 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:09:33 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:33 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.359s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Flow 'volume_create_manager' (01014630-cccd-4e03-834d-ed10a854b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fce18ee-4f6b-4445-9e61-21899aa8c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fce18ee-4f6b-4445-9e61-21899aa8c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1858379424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5808663-293a-47f6-b2ce-2941b0eae85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a187185049638263e164ee6b68b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:09:54Z,use_quota=True,user_id='2fb53d8a44a14143945842b858960930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa603cf-343d-4cb4-9284-8edf2f207a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa603cf-343d-4cb4-9284-8edf2f207a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29213898-9213-4d61-b998-2b9b3da91a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:53 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29213898-9213-4d61-b998-2b9b3da91a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5808663-293a-47f6-b2ce-2941b0eae85b', 'volume_name': 'volume-b5808663-293a-47f6-b2ce-2941b0eae85b', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d8dc10>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da137ac9-9fcd-4e38-90f0-0c79f1e446ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da137ac9-9fcd-4e38-90f0-0c79f1e446ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff13715-5a86-4f40-886a-08d61df00a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:09:54 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Volume b5808663-293a-47f6-b2ce-2941b0eae85b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5808663-293a-47f6-b2ce-2941b0eae85b', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d8dc10>}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Trying to clone b5808663-293a-47f6-b2ce-2941b0eae85b from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:09:54 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Image download 20.69 MB at 20.69 MB/s
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[af797b87-3ebc-4c2b-8640-72192ab7650c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:54 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD
Sep 12 21:09:54 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:54 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:54 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 is fetched for user 2fb53d8a44a14143945842b858960930. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4866fba8-86c3-4e7d-a426-7ee0e5d07b1e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:55 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD
Sep 12 21:09:55 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:55 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1858379424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5808663-293a-47f6-b2ce-2941b0eae85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a187185049638263e164ee6b68b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:09:54Z,use_quota=True,user_id='2fb53d8a44a14143945842b858960930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Creating volume b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:09:55 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:55 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b 1073741824
Sep 12 21:09:55 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:55 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b 1073741824" returned: 0 in 0.443s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:55 devstack sudo[105487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:09:55 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:56 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 0.298s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Attempting download of 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume b5808663-293a-47f6-b2ce-2941b0eae85b. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149bb17-1db8-49c1-bea4-78715735c010]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:56 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5
Sep 12 21:09:56 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:56 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:56 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5
Sep 12 21:09:56 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:57 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5" returned: 1 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7_kjx0csv5' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c55b4-35e2-4028-af1b-c1edc6e32d85]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:57 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD
Sep 12 21:09:57 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:57 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 was qcow2, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:09:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:57 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:09:57 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:59 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 1.567s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b37b7b1-a2d6-41ee-bd76-87c506ac58e7__6whvd2vdevstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:09:59 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Converted 112.00 MB image at 71.41 MB/s
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:59 devstack sudo[105514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b 1G
Sep 12 21:09:59 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:59 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b 1G" returned: 0 in 0.291s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d88199-ac5c-4cc2-a06e-8a4545f9a225]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:59 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:09:59 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:09:59 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:09:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:09:59 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:09:59 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:00 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 1 in 0.370s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Downloaded image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}])) to volume b5808663-293a-47f6-b2ce-2941b0eae85b successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Temporary image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 for user 2fb53d8a44a14143945842b858960930 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Marking volume b5808663-293a-47f6-b2ce-2941b0eae85b as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Copying metadata from image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 to b5808663-293a-47f6-b2ce-2941b0eae85b. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Creating volume glance metadata for volume b5808663-293a-47f6-b2ce-2941b0eae85b backed by image 7b37b7b1-a2d6-41ee-bd76-87c506ac58e7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff13715-5a86-4f40-886a-08d61df00a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5808663-293a-47f6-b2ce-2941b0eae85b', 'volume_size': 1, 'image_id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '09c4d840ba6643d19311607974bb139a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b37b7b1-a2d6-41ee-bd76-87c506ac58e7', 'created_at': datetime.datetime(2026, 9, 12, 18, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 18, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b37b7b1-a2d6-41ee-bd76-87c506ac58e7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d8dc10>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21d5c4c-0aac-4b39-b2ab-2952b1dded3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:00 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Volume volume-b5808663-293a-47f6-b2ce-2941b0eae85b (b5808663-293a-47f6-b2ce-2941b0eae85b): created successfully
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21d5c4c-0aac-4b39-b2ab-2952b1dded3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Flow 'volume_create_manager' (01014630-cccd-4e03-834d-ed10a854b829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:10:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-eb64b483-5e5b-46e7-85e5-7fe3eeb9f367 tempest-TestShelveInstance-454665345 None] Created volume successfully.
Sep 12 21:10:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4441b243-c63e-40ad-92db-884371e1bb37]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:10:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:04 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:10:04 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:04 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:04 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:10:04 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:05 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 1 in 0.682s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:10:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.165s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-b5808663-293a-47f6-b2ce-2941b0eae85b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20d196b7-e4ec-4aaa-8786-52e118901894', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:10:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-042efcb0-c8a0-46e3-b903-8095aca5c785 req-1381a8f4-621a-4587-94ba-fba94deeda2e tempest-TestShelveInstance-454665345 None] attachment_update completed successfully.
Sep 12 21:10:15 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:10:15 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=9 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Flow 'volume_create_manager' (724e338a-e56c-417a-8b59-b553db1eec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fca35c-75f4-4d10-948b-7ad273394614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fca35c-75f4-4d10-948b-7ad273394614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-365862941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13504a3b95b84625a96c8f799382dec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:10:30Z,use_quota=True,user_id='9372c4f518b54f22bb08accc658e441e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb2ee10-9757-4009-b37a-57c786cad8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb2ee10-9757-4009-b37a-57c786cad8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff7ebdd-5937-42e2-bde0-62bb1dbaab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff7ebdd-5937-42e2-bde0-62bb1dbaab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e', 'volume_name': 'volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77ce39e-0e1d-47b2-a36b-aaf74ac3babc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77ce39e-0e1d-47b2-a36b-aaf74ac3babc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3973db-9742-45b5-824a-c50fdf13ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:30 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Volume dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e', 'volume_size': 1}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-365862941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13504a3b95b84625a96c8f799382dec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:10:30Z,use_quota=True,user_id='9372c4f518b54f22bb08accc658e441e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Creating volume dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:10:30 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:30 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e 1073741824
Sep 12 21:10:30 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:30 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e 1073741824" returned: 0 in 0.406s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:30 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e
Sep 12 21:10:30 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:31 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3973db-9742-45b5-824a-c50fdf13ea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917a0865-38c3-4fd4-8746-4ab4d130a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:10:31 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Volume volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e (dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e): created successfully
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917a0865-38c3-4fd4-8746-4ab4d130a498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Flow 'volume_create_manager' (724e338a-e56c-417a-8b59-b553db1eec40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:10:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3a442376-0c39-4af0-b797-9c780ed1d9ef tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Created volume successfully.
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5629f1-d925-4be6-84fd-3c3191fd8df5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:10:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:32 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e
Sep 12 21:10:32 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:32 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.360s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73c9e6e3-7ae9-4e2e-9670-29ce9f1bc976', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:10:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-b70bab18-d4e0-4e73-8384-b206e5612bb2 req-ad530e94-af7c-4148-809a-d9ecd641308e tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] attachment_update completed successfully.
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:33 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:10:33 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:33 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.245s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:10:35 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-5d2e85f0-ff1f-43a1-ad90-f9be409f9a77 req-ccb92e8e-2922-4d83-b7f6-f0cbd975e743 tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Terminate volume connection completed successfully.
Sep 12 21:10:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-5d2e85f0-ff1f-43a1-ad90-f9be409f9a77 req-ccb92e8e-2922-4d83-b7f6-f0cbd975e743 tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Deleting attachment 73c9e6e3-7ae9-4e2e-9670-29ce9f1bc976. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Acquiring lock "cinder-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "cinder-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Acquiring lock "cinder-quobyte-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "cinder-quobyte-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f5281-62d6-44f2-8327-11c1cc6b77eb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:36 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e
Sep 12 21:10:36 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:36 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" returned: 0 in 0.370s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:36 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e
Sep 12 21:10:36 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:36 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "cinder-quobyte-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e" released by "delete_volume" :: held 0.667s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:10:36 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Created reservations ['e96eb6d3-9d7e-4289-a65c-1886bbc92222', 'df083690-b382-4605-9f78-adf32f80dea8', '773d3173-9763-4a52-9850-bec566db4339', '5d01114d-dadb-4e51-826d-2ed953ba5c14'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:37 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:10:37 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:37 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.283s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:10:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Deleted volume successfully.
Sep 12 21:10:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cc4172c7-abf9-49d6-b2d4-0d1b09905cda tempest-TestServerVolumeAttachScenarioOldVersion-1130477929 None] Lock "cinder-dac7e7ec-6cf4-4b90-a9dd-a3f63f19254e-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:10:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-14d46521-bc32-4db6-a9f2-5f1b22c2a197 req-c45119c6-7197-401d-808d-91ca34ff40d9 tempest-TestShelveInstance-454665345 None] Terminate volume connection completed successfully.
Sep 12 21:10:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-14d46521-bc32-4db6-a9f2-5f1b22c2a197 req-c45119c6-7197-401d-808d-91ca34ff40d9 tempest-TestShelveInstance-454665345 None] Deleting attachment 20d196b7-e4ec-4aaa-8786-52e118901894. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:10:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:10:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:10:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aa0d82-63f6-4e48-b57d-7b7a38d80919]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:10:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:41 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:10:41 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:41 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:10:42 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:10:42 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:10:42 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Sep 12 21:10:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 1 in 0.373s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:10:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:10:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:10:42 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44', 'name': 'volume-b5808663-293a-47f6-b2ce-2941b0eae85b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36e0053c-43aa-47eb-a19b-48534f16eab3', 'enforce_multipath': True} {{(pid=87624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 12 21:10:42 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-c891e2d5-96d6-4d11-b324-bbe2dfa9d104 req-afe1e369-bf0a-43df-ad2d-963fe153293c tempest-TestShelveInstance-454665345 None] attachment_update completed successfully.
Sep 12 21:10:52 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=22,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:10:52 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Flow 'volume_create_manager' (9e000e35-6a58-49f4-8cce-1eed6a900194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e7ea9e-5e07-4a38-8d44-c6e924fc50f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e7ea9e-5e07-4a38-8d44-c6e924fc50f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1578068716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8667cb0-3021-4071-97c3-2d509e3bc155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3614552c21b49d7838678943e0c20a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:11Z,use_quota=True,user_id='51bc15ad1efb4f238dd2334b43a50b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3694e621-b4c9-4a35-9d9e-f9bf6599d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3694e621-b4c9-4a35-9d9e-f9bf6599d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9ccb62-8142-4e32-b29a-bf311e4ce453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9ccb62-8142-4e32-b29a-bf311e4ce453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8667cb0-3021-4071-97c3-2d509e3bc155', 'volume_name': 'volume-d8667cb0-3021-4071-97c3-2d509e3bc155', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f87155-a9bf-4f50-bb5e-9cd27d987453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f87155-a9bf-4f50-bb5e-9cd27d987453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e3e598-ead3-4f41-9f85-8c1e1a05b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:11 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Volume d8667cb0-3021-4071-97c3-2d509e3bc155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8667cb0-3021-4071-97c3-2d509e3bc155', 'volume_size': 1}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1578068716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8667cb0-3021-4071-97c3-2d509e3bc155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3614552c21b49d7838678943e0c20a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:11Z,use_quota=True,user_id='51bc15ad1efb4f238dd2334b43a50b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Creating volume d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:11 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:11 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 1073741824
Sep 12 21:11:11 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:12 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 1073741824" returned: 0 in 0.556s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:12 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155
Sep 12 21:11:12 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:12 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155" returned: 0 in 0.414s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e3e598-ead3-4f41-9f85-8c1e1a05b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8667cb0-3021-4071-97c3-2d509e3bc155', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1071c381-1597-4db3-9fad-28008f3abbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:12 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Volume volume-d8667cb0-3021-4071-97c3-2d509e3bc155 (d8667cb0-3021-4071-97c3-2d509e3bc155): created successfully
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1071c381-1597-4db3-9fad-28008f3abbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Flow 'volume_create_manager' (9e000e35-6a58-49f4-8cce-1eed6a900194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4914e8af-e180-48cb-a2e1-0b48a3f78219 tempest-TestImageHashVerification-686739966 None] Created volume successfully.
Sep 12 21:11:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-03436a98-c125-462a-8a78-8ec3d90d9107 tempest-TestShelveInstance-454665345 None] Terminate volume connection completed successfully.
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-03436a98-c125-462a-8a78-8ec3d90d9107 tempest-TestShelveInstance-454665345 None] Deleting attachment 36e0053c-43aa-47eb-a19b-48534f16eab3. {{(pid=87624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Acquiring lock "cinder-b5808663-293a-47f6-b2ce-2941b0eae85b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Lock "cinder-b5808663-293a-47f6-b2ce-2941b0eae85b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Acquiring lock "cinder-quobyte-b5808663-293a-47f6-b2ce-2941b0eae85b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Lock "cinder-quobyte-b5808663-293a-47f6-b2ce-2941b0eae85b" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[62225dbb-c38e-445a-92d1-0fed68a470ce]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:13 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:11:13 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:13 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 0.418s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:14 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:11:14 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:14 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 1 in 0.356s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:14 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b
Sep 12 21:11:14 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[363ea078-ae1d-4f9d-b051-089891123371]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:14 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5808663-293a-47f6-b2ce-2941b0eae85b" returned: 0 in 0.284s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Lock "cinder-quobyte-b5808663-293a-47f6-b2ce-2941b0eae85b" released by "delete_volume" :: held 1.131s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:14 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155
Sep 12 21:11:14 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG cinder.quota [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Created reservations ['b7a19fcc-4639-4a9d-a34c-c9198c7327a9', '5292599b-0317-4c98-b6be-a3a1781ba00f', '97a95480-f761-4aa9-9b81-03bfec559269', 'a8132073-e636-45b8-a8ce-32e4190d763a'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:14 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:14 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:15 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155" returned: 0 in 0.448s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[11502837-19ad-474c-8331-2c6e78f25808]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:15 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.271s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG cinder.manager [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Deleted volume successfully.
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [req-46aa938d-afaa-4935-80a5-1ddd2f00699c req-102d7811-5a24-4bb8-add4-21b1958c46f3 tempest-TestShelveInstance-454665345 None] Lock "cinder-b5808663-293a-47f6-b2ce-2941b0eae85b-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:15 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155
Sep 12 21:11:15 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:15 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155" returned: 0 in 0.365s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 /opt/stack/data/cinder/conversion/d8667cb0-3021-4071-97c3-2d509e3bc155.temp_image.dcc6a628-ee7b-4192-b42f-88fa3c0d5ce8eu632jwy.img {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:15 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 /opt/stack/data/cinder/conversion/d8667cb0-3021-4071-97c3-2d509e3bc155.temp_image.dcc6a628-ee7b-4192-b42f-88fa3c0d5ce8eu632jwy.img
Sep 12 21:11:15 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:19 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 /opt/stack/data/cinder/conversion/d8667cb0-3021-4071-97c3-2d509e3bc155.temp_image.dcc6a628-ee7b-4192-b42f-88fa3c0d5ce8eu632jwy.img" returned: 0 in 4.531s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a7f81-1cf5-4687-929d-a9ebda2a2bac]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:20 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155
Sep 12 21:11:20 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:20 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155" returned: 0 in 0.610s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:20 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/conversion/d8667cb0-3021-4071-97c3-2d509e3bc155.temp_image.dcc6a628-ee7b-4192-b42f-88fa3c0d5ce8eu632jwy.img {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:11:20 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Converted 1024.00 MB image at 225.89 MB/s
Sep 12 21:11:20 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] dcc6a628-ee7b-4192-b42f-88fa3c0d5ce8 was raw, no need to convert to raw {{(pid=87624) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Sep 12 21:11:25 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:11:30 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:33 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:33 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:33 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:33 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Flow 'volume_create_manager' (80094f8e-5a65-432a-820a-6c00a05187df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b142322-9033-4131-ae36-7ee823e1b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b142322-9033-4131-ae36-7ee823e1b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73411b9c7e9b4d65be581c73c6e35ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:34Z,use_quota=True,user_id='1b50f5adeacc43108a4f404ee7754c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ed435c2-fd95-45c9-a26d-031d41f83e48),volume_type_id=2ed435c2-fd95-45c9-a26d-031d41f83e48)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a3e25f-f68a-4f91-b84e-beab002f19bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a3e25f-f68a-4f91-b84e-beab002f19bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbbab086-9b1c-4465-bd8f-3634dd31aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbbab086-9b1c-4465-bd8f-3634dd31aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3ac9f41-0bfc-4b42-9456-09da6bf6a6d8', 'volume_name': 'volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8', 'volume_size': 1, 'image_id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df7ffc7d62bcb588e409340ab1904cf6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73411b9c7e9b4d65be581c73c6e35ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf6f139cf0fdc43d8828abb867f70109815c8e7082d97403e87241bcc611b5f3776275c9a9f17d8e67d4f889d0a41af5c12727738c63527fe0caad8dbf5741f', 'id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'created_at': datetime.datetime(2026, 9, 12, 19, 11, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 11, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d2ee70>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f03a7ba-41d7-4de1-9314-da3217293b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f03a7ba-41d7-4de1-9314-da3217293b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d898b1ea-9574-4d5e-9e38-2c562936dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:34 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Volume d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8', 'volume_size': 1, 'image_id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df7ffc7d62bcb588e409340ab1904cf6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73411b9c7e9b4d65be581c73c6e35ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf6f139cf0fdc43d8828abb867f70109815c8e7082d97403e87241bcc611b5f3776275c9a9f17d8e67d4f889d0a41af5c12727738c63527fe0caad8dbf5741f', 'id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'created_at': datetime.datetime(2026, 9, 12, 19, 11, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 11, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d2ee70>}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Trying to clone d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 from image b5c8302d-75dd-4582-a77c-1da9afc3d87c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:11:34 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Image download 0.00 MB at 0.00 MB/s
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb2bd0-7ada-43bf-870c-51e399f19d5b]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:34 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD
Sep 12 21:11:34 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:34 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:35 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD
Sep 12 21:11:35 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:35 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Temporary image b5c8302d-75dd-4582-a77c-1da9afc3d87c is fetched for user 1b50f5adeacc43108a4f404ee7754c95. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b6b94-da9a-45c0-8134-00ad273ea7e9]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:35 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD
Sep 12 21:11:35 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:35 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:35 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD
Sep 12 21:11:35 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:36 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.828s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Uploaded volume to glance image-id: dcc6a628-ee7b-4192-b42f-88fa3c0d5ce8. {{(pid=87624) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.327s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73411b9c7e9b4d65be581c73c6e35ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:34Z,use_quota=True,user_id='1b50f5adeacc43108a4f404ee7754c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ed435c2-fd95-45c9-a26d-031d41f83e48),volume_type_id=2ed435c2-fd95-45c9-a26d-031d41f83e48)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Creating volume d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:40 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:40 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 1073741824
Sep 12 21:11:40 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b9ed47ca-7fde-4184-8813-e15ed42f1c6e tempest-TestImageHashVerification-686739966 None] Copy volume to image completed successfully.
Sep 12 21:11:40 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 1073741824" returned: 0 in 0.392s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:40 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:40 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:41 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 0 in 0.248s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Attempting download of b5c8302d-75dd-4582-a77c-1da9afc3d87c ((None, [{'url': 'file:///opt/stack/data/glance/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'metadata': {}}])) to volume d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc2f88-e85a-40a2-9433-ba0d1d3c61de]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:41 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz
Sep 12 21:11:41 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:41 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz" returned: 0 in 0.328s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:41 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz
Sep 12 21:11:41 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:41 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz" returned: 1 in 0.318s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5c8302d-75dd-4582-a77c-1da9afc3d87c_zln8ttxz' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4b1651-64e7-433c-b1ad-fc716bd6c648]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Acquiring lock "cinder-d8667cb0-3021-4071-97c3-2d509e3bc155-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Lock "cinder-d8667cb0-3021-4071-97c3-2d509e3bc155-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:41 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD
Sep 12 21:11:41 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Acquiring lock "cinder-quobyte-d8667cb0-3021-4071-97c3-2d509e3bc155" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Lock "cinder-quobyte-d8667cb0-3021-4071-97c3-2d509e3bc155" acquired by "delete_volume" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f4356a-bdd5-4a91-b2c4-1b7297c64a02]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:42 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155
Sep 12 21:11:42 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:42 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:42 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD
Sep 12 21:11:42 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:42 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:42 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155
Sep 12 21:11:42 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:42 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] b5c8302d-75dd-4582-a77c-1da9afc3d87c was raw, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:42 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:42 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:42 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d8667cb0-3021-4071-97c3-2d509e3bc155" returned: 0 in 0.247s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Lock "cinder-quobyte-d8667cb0-3021-4071-97c3-2d509e3bc155" released by "delete_volume" :: held 0.660s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Created reservations ['f20cd26b-8820-462a-bdb6-712d18b52dfb', '0cb5c294-f25a-4911-a7f9-55ca85356b06', '5130f85c-40af-4291-af5c-3912f42962cd', '1a2f11cd-bc3f-4d57-ba7e-4f4655136b70'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:42 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:42 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:42 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5c8302d-75dd-4582-a77c-1da9afc3d87c__5jvme2zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:11:42 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Converted 0.00 MB image at 0.00 MB/s
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:42 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 1G
Sep 12 21:11:42 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:42 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.266s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:42 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:43 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Deleted volume successfully.
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-8c8ffcf3-26e1-48ae-b612-b92b4c1d718c tempest-TestImageHashVerification-686739966 None] Lock "cinder-d8667cb0-3021-4071-97c3-2d509e3bc155-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:43 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 1G" returned: 0 in 0.294s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[532b5882-bfc0-4da4-8753-46f21cb8fea6]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:43 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:43 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:43 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:43 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:43 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:43 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 1 in 0.396s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Downloaded image b5c8302d-75dd-4582-a77c-1da9afc3d87c ((None, [{'url': 'file:///opt/stack/data/glance/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'metadata': {}}])) to volume d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Temporary image b5c8302d-75dd-4582-a77c-1da9afc3d87c for user 1b50f5adeacc43108a4f404ee7754c95 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Marking volume d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Copying metadata from image b5c8302d-75dd-4582-a77c-1da9afc3d87c to d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:11:43 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Creating volume glance metadata for volume d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 backed by image b5c8302d-75dd-4582-a77c-1da9afc3d87c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'df7ffc7d62bcb588e409340ab1904cf6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d898b1ea-9574-4d5e-9e38-2c562936dce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8', 'volume_size': 1, 'image_id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df7ffc7d62bcb588e409340ab1904cf6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73411b9c7e9b4d65be581c73c6e35ea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf6f139cf0fdc43d8828abb867f70109815c8e7082d97403e87241bcc611b5f3776275c9a9f17d8e67d4f889d0a41af5c12727738c63527fe0caad8dbf5741f', 'id': 'b5c8302d-75dd-4582-a77c-1da9afc3d87c', 'created_at': datetime.datetime(2026, 9, 12, 19, 11, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 11, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5c8302d-75dd-4582-a77c-1da9afc3d87c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056d2ee70>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc5e545-87b8-467c-b69a-90483e116bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:44 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Volume volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 (d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8): created successfully
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc5e545-87b8-467c-b69a-90483e116bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Flow 'volume_create_manager' (80094f8e-5a65-432a-820a-6c00a05187df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-764617a6-91a2-40a7-bac8-474ac2804cb4 tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Created volume successfully.
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Acquiring lock "cinder-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "cinder-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Acquiring lock "cinder-quobyte-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "cinder-quobyte-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7512bfa-2a23-4854-8c5a-0d55a0163964]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:44 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:44 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:45 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:45 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:45 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:45 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 1 in 0.380s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:45 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8
Sep 12 21:11:45 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:45 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" returned: 0 in 0.246s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "cinder-quobyte-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8" released by "delete_volume" :: held 1.046s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:45 devstack cinder-volume[87624]: WARNING cinder.quota [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:11:45 devstack cinder-volume[87624]: WARNING cinder.quota [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Created reservations ['3336ee34-7b0a-4d76-94bc-0835ceedc52b', '57dde709-cd2a-4588-8f92-bb1274eacca9', '01d4dcec-2956-48d9-bb2e-06ec8d71a3f5', 'cfed2d86-98f4-4c32-8ce1-68dcd2ed2293'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:45 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:45 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:46 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.247s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:46 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Deleted volume successfully.
Sep 12 21:11:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6bbfc7b4-d247-4c79-9779-529b85f150eb tempest-VolumeAndVolumeTypeFromImageTest-373671146 None] Lock "cinder-d3ac9f41-0bfc-4b42-9456-09da6bf6a6d8-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (b3385ea0-6e0a-4187-8b70-3ec25077fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a922c489-b135-48bd-9e19-3f265f5abb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a922c489-b135-48bd-9e19-3f265f5abb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1925643523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8a4130-c9d6-4926-b29c-824eeb7e1523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:51Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4754160-9a43-4029-8c02-7475c9980784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4754160-9a43-4029-8c02-7475c9980784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbc7bde-99b4-424a-abc3-330eb5b2b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbc7bde-99b4-424a-abc3-330eb5b2b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8a4130-c9d6-4926-b29c-824eeb7e1523', 'volume_name': 'volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a863092-0b4e-42d7-99b2-b93e81f9a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a863092-0b4e-42d7-99b2-b93e81f9a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4613f820-9fad-474b-b549-a943aa1dc022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Volume ad8a4130-c9d6-4926-b29c-824eeb7e1523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523', 'volume_size': 1}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1925643523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8a4130-c9d6-4926-b29c-824eeb7e1523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:51Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Creating volume ad8a4130-c9d6-4926-b29c-824eeb7e1523 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:51 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:51 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 1073741824
Sep 12 21:11:51 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (d9ef4805-28c3-4057-b1e5-8dcf9804efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea245540-73e2-465f-9591-f190f12fb9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea245540-73e2-465f-9591-f190f12fb9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1335167331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:51Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a214ea63-0ff6-415b-9816-43c4716e4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a214ea63-0ff6-415b-9816-43c4716e4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebd3476-13b8-45e1-b2c8-053e25e42865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebd3476-13b8-45e1-b2c8-053e25e42865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4', 'volume_name': 'volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c488e7e1-adb0-4a1b-89a5-0bcf92ba7499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c488e7e1-adb0-4a1b-89a5-0bcf92ba7499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192975bf-65e3-4158-92af-b5591b94e1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Volume dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4', 'volume_size': 1}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:51 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 1073741824" returned: 0 in 0.572s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:51 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523
Sep 12 21:11:51 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (f2bcef59-c708-4312-bebb-83e3ca42c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e14a27-5600-4503-b80d-009a1b4c4bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e14a27-5600-4503-b80d-009a1b4c4bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-634391489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d880d60f-c994-41d1-8548-75863630e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:52Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0349b37-765e-455a-809e-aff4835dab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0349b37-765e-455a-809e-aff4835dab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49be37c3-9616-4292-9323-d14fc22b6954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49be37c3-9616-4292-9323-d14fc22b6954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd880d60f-c994-41d1-8548-75863630e1da', 'volume_name': 'volume-d880d60f-c994-41d1-8548-75863630e1da', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72511b3-9804-4487-828e-96611b4c821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72511b3-9804-4487-828e-96611b4c821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9612db6-beeb-49df-ab2c-219bfbb8d134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Volume d880d60f-c994-41d1-8548-75863630e1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d880d60f-c994-41d1-8548-75863630e1da', 'volume_size': 1}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:52 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523" returned: 0 in 0.318s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1335167331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:51Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Creating volume dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:52 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4613f820-9fad-474b-b549-a943aa1dc022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0424ddae-fa67-49ce-8cc2-75bd6ff29da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 1073741824
Sep 12 21:11:52 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Volume volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 (ad8a4130-c9d6-4926-b29c-824eeb7e1523): created successfully
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0424ddae-fa67-49ce-8cc2-75bd6ff29da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (b3385ea0-6e0a-4187-8b70-3ec25077fc85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f850f3a1-8c1b-4588-864e-d28b1ffe0149 tempest-CreateVolumesFromImageTest-2109843371 None] Created volume successfully.
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (deff1d33-aa7c-4241-9908-58c8058e4ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74658db-99d5-4fdf-b9c6-cae8d7e514cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74658db-99d5-4fdf-b9c6-cae8d7e514cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1323156811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:52Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90633543-97a1-4995-bf4b-280f7905a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90633543-97a1-4995-bf4b-280f7905a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426a5a06-37ad-4fbb-affa-52ece52d28f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426a5a06-37ad-4fbb-affa-52ece52d28f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30', 'volume_name': 'volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f982d810-048d-4c36-8336-38891777bbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f982d810-048d-4c36-8336-38891777bbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a78f372-4cd9-4564-9d90-2234b1579397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Volume 2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30', 'volume_size': 1}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:52 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (3238acac-7c83-486c-90a2-988ba2435770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fd16c2-c9f3-445c-a7b8-2ce5311a05b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 1073741824" returned: 0 in 0.570s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fd16c2-c9f3-445c-a7b8-2ce5311a05b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958048551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0508eea-f3d3-4ffe-92b2-abf380070f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:53Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cbef31-26b4-4a79-aaf7-ae37bff58b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cbef31-26b4-4a79-aaf7-ae37bff58b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f628fc73-9291-4d00-82d5-20418cad42df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f628fc73-9291-4d00-82d5-20418cad42df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0508eea-f3d3-4ffe-92b2-abf380070f00', 'volume_name': 'volume-f0508eea-f3d3-4ffe-92b2-abf380070f00', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f822bb92-8a75-435d-b7bb-d1c0dc168c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f822bb92-8a75-435d-b7bb-d1c0dc168c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1783a47-a48b-4979-a751-58a80b13aa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Volume f0508eea-f3d3-4ffe-92b2-abf380070f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0508eea-f3d3-4ffe-92b2-abf380070f00', 'volume_size': 1}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:52 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4
Sep 12 21:11:52 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:53 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4" returned: 0 in 0.251s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-634391489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d880d60f-c994-41d1-8548-75863630e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:52Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Creating volume d880d60f-c994-41d1-8548-75863630e1da {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:53 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192975bf-65e3-4158-92af-b5591b94e1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:53 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da 1073741824
Sep 12 21:11:53 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314c4706-e5aa-4609-81d8-9d9178e735c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Volume volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 (dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4): created successfully
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314c4706-e5aa-4609-81d8-9d9178e735c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (d9ef4805-28c3-4057-b1e5-8dcf9804efe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-86669af6-ff75-4a41-8933-cbc3adfc1153 tempest-CreateVolumesFromImageTest-2109843371 None] Created volume successfully.
Sep 12 21:11:53 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da 1073741824" returned: 0 in 0.446s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:53 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da
Sep 12 21:11:53 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:53 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da" returned: 0 in 0.251s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1323156811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:52Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Creating volume 2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:53 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9612db6-beeb-49df-ab2c-219bfbb8d134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d880d60f-c994-41d1-8548-75863630e1da', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:53 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 1073741824
Sep 12 21:11:53 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ccd832-956a-4137-b8e7-ca1840ed0ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Volume volume-d880d60f-c994-41d1-8548-75863630e1da (d880d60f-c994-41d1-8548-75863630e1da): created successfully
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ccd832-956a-4137-b8e7-ca1840ed0ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (f2bcef59-c708-4312-bebb-83e3ca42c91c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-896a3359-e198-4001-b720-d9a24906cf19 tempest-CreateVolumesFromImageTest-2109843371 None] Created volume successfully.
Sep 12 21:11:54 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 1073741824" returned: 0 in 0.457s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:54 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30
Sep 12 21:11:54 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:54 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.792s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958048551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0508eea-f3d3-4ffe-92b2-abf380070f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616ebd7a42f34da286a9ef3b63f90fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:53Z,use_quota=True,user_id='c1b20f43ceac42d9ad2d668cac13c24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Creating volume f0508eea-f3d3-4ffe-92b2-abf380070f00 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:54 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:54 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 1073741824
Sep 12 21:11:54 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a78f372-4cd9-4564-9d90-2234b1579397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300531e7-5956-44b0-aa3d-b16a975798d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:54 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Volume volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 (2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30): created successfully
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300531e7-5956-44b0-aa3d-b16a975798d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (deff1d33-aa7c-4241-9908-58c8058e4ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b65d3f77-30bc-4708-885a-37bf988fde8a tempest-CreateVolumesFromImageTest-2109843371 None] Created volume successfully.
Sep 12 21:11:55 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 1073741824" returned: 0 in 0.467s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:55 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00
Sep 12 21:11:55 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:55 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1783a47-a48b-4979-a751-58a80b13aa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0508eea-f3d3-4ffe-92b2-abf380070f00', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beca86a3-4df1-4b11-9d19-9a0225ce51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:55 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Volume volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 (f0508eea-f3d3-4ffe-92b2-abf380070f00): created successfully
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beca86a3-4df1-4b11-9d19-9a0225ce51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:55 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Flow 'volume_create_manager' (3238acac-7c83-486c-90a2-988ba2435770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e6c6dd07-5c77-430e-a15d-2ec04a30563b tempest-CreateVolumesFromImageTest-2109843371 None] Created volume successfully.
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-f0508eea-f3d3-4ffe-92b2-abf380070f00-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-f0508eea-f3d3-4ffe-92b2-abf380070f00-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-quobyte-f0508eea-f3d3-4ffe-92b2-abf380070f00" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-f0508eea-f3d3-4ffe-92b2-abf380070f00" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb841cc-09ec-49ab-b1dc-1d783653f090]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:56 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00
Sep 12 21:11:56 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:56 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:56 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00
Sep 12 21:11:56 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:56 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-f0508eea-f3d3-4ffe-92b2-abf380070f00" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-f0508eea-f3d3-4ffe-92b2-abf380070f00" released by "delete_volume" :: held 0.655s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:56 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Created reservations ['8f9bcf2d-7e18-4f8f-b933-23bbedd30fd8', '9df79b84-4038-4482-9ec8-8328b3263071', '79f54b2d-d32d-4454-9c25-d8a1411bb8a5', '3174d972-134d-4cc6-b415-90019fa26480'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:57 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:57 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Flow 'volume_create_manager' (6a06a2ac-2433-4a7f-b0e5-c56cbbb4cdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d986a2e2-be6c-4f50-987f-be8154bfabb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d986a2e2-be6c-4f50-987f-be8154bfabb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e9e132-c178-4a7c-b8cf-bc25cf180f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa6a672ba95463b9425381be5108bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:57Z,use_quota=True,user_id='3233858516694ad19830f412b63e9871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cb9c49-1ebe-451c-9215-c67c52465c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cb9c49-1ebe-451c-9215-c67c52465c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c208f5-5721-47d1-8e7a-650a2c66f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:11:57 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:57 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Deleted volume successfully.
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1b099bcb-c1a0-4d8c-8838-c66aa4e71b0c tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-f0508eea-f3d3-4ffe-92b2-abf380070f00-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-quobyte-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30" acquired by "delete_volume" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d80d8db-5ca7-482d-bc5e-6551204a9f84]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c208f5-5721-47d1-8e7a-650a2c66f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6e9e132-c178-4a7c-b8cf-bc25cf180f57', 'volume_name': 'volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57', 'volume_size': 1, 'image_id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '433888efae481031e6b13289a2f23632', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'daa6a672ba95463b9425381be5108bba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b9f4d7da2db6ed4974ee1a30c9c97c5913ca72d880119824bd855ca19443862ee0db77d2040d39079090201a9c955453bbd01a5cd42a5f277d636209b3b91a5', 'id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'created_at': datetime.datetime(2026, 9, 12, 19, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d504cba0aa0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad740273-f926-4502-8da0-43b1b61d2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad740273-f926-4502-8da0-43b1b61d2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fe3fd1-9433-40b9-832e-91c78b8e88bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:11:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Volume e6e9e132-c178-4a7c-b8cf-bc25cf180f57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57', 'volume_size': 1, 'image_id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '433888efae481031e6b13289a2f23632', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'daa6a672ba95463b9425381be5108bba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b9f4d7da2db6ed4974ee1a30c9c97c5913ca72d880119824bd855ca19443862ee0db77d2040d39079090201a9c955453bbd01a5cd42a5f277d636209b3b91a5', 'id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'created_at': datetime.datetime(2026, 9, 12, 19, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d504cba0aa0>}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Trying to clone e6e9e132-c178-4a7c-b8cf-bc25cf180f57 from image 5e5c8434-b45c-4e47-9b25-ffacc9694af4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:11:57 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30
Sep 12 21:11:57 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:11:57 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Image download 0.00 MB at 0.00 MB/s
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b34cab-b74a-4b7f-9bcd-f9665d8e4583]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:57 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD
Sep 12 21:11:57 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:57 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30" returned: 0 in 0.360s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:57 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30
Sep 12 21:11:57 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:57 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:58 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30" returned: 0 in 0.244s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30" released by "delete_volume" :: held 0.653s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:58 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD
Sep 12 21:11:58 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Created reservations ['336dddde-5358-443d-8e58-34c4552a29a9', 'b212e4a3-becb-4217-a2bd-2f0440c8db18', 'dcfb8a1a-b248-4202-b465-8cb8cc1789bc', '675d4de8-96df-4a80-92e0-60307c1ba4e2'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:58 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:58 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:58 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Temporary image 5e5c8434-b45c-4e47-9b25-ffacc9694af4 is fetched for user 3233858516694ad19830f412b63e9871. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d630e-72d6-4019-9b65-de58d725bb44]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:58 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.255s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Deleted volume successfully.
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7aef7894-dfc2-4a0d-80c3-fedf055b4847 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-2713e06d-6a4f-4a4e-a3d3-6fcb5e918d30-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:58 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD
Sep 12 21:11:58 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-d880d60f-c994-41d1-8548-75863630e1da-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-d880d60f-c994-41d1-8548-75863630e1da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-quobyte-d880d60f-c994-41d1-8548-75863630e1da" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-d880d60f-c994-41d1-8548-75863630e1da" acquired by "delete_volume" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24d8a0-9018-406a-800c-6c6d54aafb98]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:58 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da
Sep 12 21:11:58 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:58 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:58 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD
Sep 12 21:11:58 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:58 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:58 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da
Sep 12 21:11:58 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:59 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e9e132-c178-4a7c-b8cf-bc25cf180f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa6a672ba95463b9425381be5108bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:11:57Z,use_quota=True,user_id='3233858516694ad19830f412b63e9871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Creating volume e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:11:59 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:59 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 1073741824
Sep 12 21:11:59 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:59 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d880d60f-c994-41d1-8548-75863630e1da" returned: 0 in 0.254s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-d880d60f-c994-41d1-8548-75863630e1da" released by "delete_volume" :: held 0.659s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Created reservations ['080c880c-13a7-416d-85c6-d8f0615258e9', 'cfff6421-21e3-4f44-bdf2-19d8cbf910ef', '3919e1f8-5f5a-4ebe-acf9-49c96abb6dca', '8a74ae37-c1ba-4d47-b1b3-53997decc0f8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:59 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:11:59 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:59 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 1073741824" returned: 0 in 0.417s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:59 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:11:59 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:59 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.265s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:11:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Deleted volume successfully.
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-b57be7eb-7566-4c08-8e55-716ea87c1980 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-d880d60f-c994-41d1-8548-75863630e1da-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-quobyte-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a67739-6abb-4cfa-a9af-20d2f7486f03]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:59 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 0 in 0.264s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Attempting download of 5e5c8434-b45c-4e47-9b25-ffacc9694af4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'metadata': {}}])) to volume e6e9e132-c178-4a7c-b8cf-bc25cf180f57. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6ae69-4dee-4b41-aab4-03361f412992]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:11:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:11:59 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4
Sep 12 21:11:59 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:11:59 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s
Sep 12 21:11:59 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:00 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4" returned: 0 in 0.358s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:00 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4
Sep 12 21:12:00 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:00 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s" returned: 0 in 0.330s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:00 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s
Sep 12 21:12:00 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:00 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4" released by "delete_volume" :: held 0.650s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Created reservations ['f8aa1b32-3cc5-4e06-bc5d-db6d933e64ff', '07830221-528f-41ea-babe-704ddaf30f27', 'd0d3ce13-17e6-4dec-8112-0e3d8a8ad7c7', 'd7f8a826-c634-4a4e-8ba1-6dfe366cac59'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:00 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s" returned: 1 in 0.337s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5e5c8434-b45c-4e47-9b25-ffacc9694af4_0_6pwl2s' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[af60ca9a-4bf7-4a0d-aedf-30e94efe38b8]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:00 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:00 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:00 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD
Sep 12 21:12:00 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:00 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.273s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Deleted volume successfully.
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6040602c-e99a-41f3-b935-29280e66e523 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-dfe8d0bf-10cf-45f5-afc8-97fe5a81a9a4-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-ad8a4130-c9d6-4926-b29c-824eeb7e1523-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-ad8a4130-c9d6-4926-b29c-824eeb7e1523-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:00 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "cinder-quobyte-ad8a4130-c9d6-4926-b29c-824eeb7e1523" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-ad8a4130-c9d6-4926-b29c-824eeb7e1523" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d50604-e01d-496e-b4f8-1322c4217c3b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:01 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD
Sep 12 21:12:01 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:01 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523
Sep 12 21:12:01 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:01 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] 5e5c8434-b45c-4e47-9b25-ffacc9694af4 was raw, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:01 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:12:01 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:01 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523" returned: 0 in 0.371s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:01 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523
Sep 12 21:12:01 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:01 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 0 in 0.333s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5e5c8434-b45c-4e47-9b25-ffacc9694af4_06dj6uh6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:12:01 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Converted 0.00 MB image at 0.00 MB/s
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:01 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad8a4130-c9d6-4926-b29c-824eeb7e1523" returned: 0 in 0.262s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-quobyte-ad8a4130-c9d6-4926-b29c-824eeb7e1523" released by "delete_volume" :: held 0.672s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:01 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 1G
Sep 12 21:12:01 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Created reservations ['1cc2f74d-0a20-438a-9b8d-075b72b7c5f5', 'e0366378-ca1a-456a-aeee-7fc4b38ed5d1', 'edbc110f-c929-4cff-a6d0-984d6e86f508', '6a044eb3-3f78-4ae1-9f7c-95426c878833'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:01 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:01 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:01 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 1G" returned: 0 in 0.277s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3503dc-146e-4c41-8255-d1ecaf3a8cca]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:02 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.260s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Deleted volume successfully.
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a44296ca-5bb1-45db-9e73-2f5c470a00e6 tempest-CreateVolumesFromImageTest-2109843371 None] Lock "cinder-ad8a4130-c9d6-4926-b29c-824eeb7e1523-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:02 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:12:02 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:02 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 0 in 0.386s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:02 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:12:02 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:02 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 1 in 0.360s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Downloaded image 5e5c8434-b45c-4e47-9b25-ffacc9694af4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'metadata': {}}])) to volume e6e9e132-c178-4a7c-b8cf-bc25cf180f57 successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Temporary image 5e5c8434-b45c-4e47-9b25-ffacc9694af4 for user 3233858516694ad19830f412b63e9871 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Marking volume e6e9e132-c178-4a7c-b8cf-bc25cf180f57 as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Copying metadata from image 5e5c8434-b45c-4e47-9b25-ffacc9694af4 to e6e9e132-c178-4a7c-b8cf-bc25cf180f57. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Creating volume glance metadata for volume e6e9e132-c178-4a7c-b8cf-bc25cf180f57 backed by image 5e5c8434-b45c-4e47-9b25-ffacc9694af4 with: {'image_id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '433888efae481031e6b13289a2f23632', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fe3fd1-9433-40b9-832e-91c78b8e88bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57', 'volume_size': 1, 'image_id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '433888efae481031e6b13289a2f23632', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'daa6a672ba95463b9425381be5108bba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b9f4d7da2db6ed4974ee1a30c9c97c5913ca72d880119824bd855ca19443862ee0db77d2040d39079090201a9c955453bbd01a5cd42a5f277d636209b3b91a5', 'id': '5e5c8434-b45c-4e47-9b25-ffacc9694af4', 'created_at': datetime.datetime(2026, 9, 12, 19, 11, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5e5c8434-b45c-4e47-9b25-ffacc9694af4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d504cba0aa0>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452b29e-f548-40dd-8725-d8f6f3f833c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:02 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Volume volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 (e6e9e132-c178-4a7c-b8cf-bc25cf180f57): created successfully
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452b29e-f548-40dd-8725-d8f6f3f833c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Flow 'volume_create_manager' (6a06a2ac-2433-4a7f-b0e5-c56cbbb4cdd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ea55bcc1-99a9-43e6-8f84-b3d35766688e tempest-VolumeImageDependencyTests-1061977482 None] Created volume successfully.
Sep 12 21:12:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Acquiring lock "cinder-e6e9e132-c178-4a7c-b8cf-bc25cf180f57-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Lock "cinder-e6e9e132-c178-4a7c-b8cf-bc25cf180f57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Acquiring lock "cinder-quobyte-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Lock "cinder-quobyte-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab57e3b-da21-4de0-b348-d420d58c9c58]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:03 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:12:03 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:04 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 0 in 0.375s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:04 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:12:04 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:04 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 1 in 0.374s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:04 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57
Sep 12 21:12:04 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:04 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" returned: 0 in 0.263s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Lock "cinder-quobyte-e6e9e132-c178-4a7c-b8cf-bc25cf180f57" released by "delete_volume" :: held 1.082s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Created reservations ['3177a37d-e3ac-4c19-90a1-c75dc8977989', 'cf1cb28e-4445-4b86-95ff-c938137c379f', '3e393f03-a459-46f6-b64f-b3086cbe2d55', '95e74c14-b5cc-4842-aa5d-e3896c6802f1'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:04 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:04 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Flow 'volume_create_manager' (51ea3714-1aeb-498b-8d88-a459deb2004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a614d0-0abd-4346-b42e-551e7624dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a614d0-0abd-4346-b42e-551e7624dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b20ddc-020b-4979-9e93-d9dd1f117dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a3fa91de74e2782d34529c5cb61af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:05Z,use_quota=True,user_id='c6dffe10fc51455fad49110f1f0f98ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22842a39-4f43-4884-9bbb-7efb4e004883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22842a39-4f43-4884-9bbb-7efb4e004883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3684de-db35-4b32-b773-f22120bc5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3684de-db35-4b32-b773-f22120bc5454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b20ddc-020b-4979-9e93-d9dd1f117dc3', 'volume_name': 'volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2b4bf4-bca9-439b-8927-df300f60b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2b4bf4-bca9-439b-8927-df300f60b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cb08ef-ed53-4a0e-a486-60c769134bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:04 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Volume 56b20ddc-020b-4979-9e93-d9dd1f117dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3', 'volume_size': 1}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b20ddc-020b-4979-9e93-d9dd1f117dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a3fa91de74e2782d34529c5cb61af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:05Z,use_quota=True,user_id='c6dffe10fc51455fad49110f1f0f98ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Creating volume 56b20ddc-020b-4979-9e93-d9dd1f117dc3 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:12:04 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:12:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:05 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 1073741824
Sep 12 21:12:05 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:05 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.291s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Deleted volume successfully.
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-0ce3464d-a970-431a-9f73-686c8cde8792 tempest-VolumeImageDependencyTests-1061977482 None] Lock "cinder-e6e9e132-c178-4a7c-b8cf-bc25cf180f57-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:05 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 1073741824" returned: 0 in 0.425s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:05 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3
Sep 12 21:12:05 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:05 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3" returned: 0 in 0.243s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cb08ef-ed53-4a0e-a486-60c769134bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca27de48-df4c-4632-baab-a20847770c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:05 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Volume volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 (56b20ddc-020b-4979-9e93-d9dd1f117dc3): created successfully
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca27de48-df4c-4632-baab-a20847770c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:05 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Flow 'volume_create_manager' (51ea3714-1aeb-498b-8d88-a459deb2004d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2c95640f-12c5-49a1-99f0-50c3597de8a3 tempest-CinderUnicodeTest-1409970758 None] Created volume successfully.
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Flow 'volume_create_manager' (7ce9bf5b-9a56-4d07-995f-2e4aaaf5f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884b8a4d-415e-476a-9101-27fa2f34995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884b8a4d-415e-476a-9101-27fa2f34995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1839915199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9394b35-8587-457e-8199-dbe22e6766a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a3fa91de74e2782d34529c5cb61af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:06Z,use_quota=True,user_id='c6dffe10fc51455fad49110f1f0f98ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3552a001-60b0-4375-9c6f-d10b0e7d3814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3552a001-60b0-4375-9c6f-d10b0e7d3814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01011830-5754-4a18-bfc1-af0bcb2869b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01011830-5754-4a18-bfc1-af0bcb2869b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9394b35-8587-457e-8199-dbe22e6766a3', 'volume_name': 'volume-d9394b35-8587-457e-8199-dbe22e6766a3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1de119-c4ba-4186-8d57-5f11605c332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1de119-c4ba-4186-8d57-5f11605c332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b16c9f-92fe-4749-96b6-73c3e1f64f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:06 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Volume d9394b35-8587-457e-8199-dbe22e6766a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9394b35-8587-457e-8199-dbe22e6766a3', 'volume_size': 1}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1839915199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9394b35-8587-457e-8199-dbe22e6766a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880a3fa91de74e2782d34529c5cb61af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:06Z,use_quota=True,user_id='c6dffe10fc51455fad49110f1f0f98ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Creating volume d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:12:06 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:06 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 1073741824
Sep 12 21:12:06 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:06 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 1073741824" returned: 0 in 0.450s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:06 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3
Sep 12 21:12:06 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:07 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3" returned: 0 in 0.254s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b16c9f-92fe-4749-96b6-73c3e1f64f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9394b35-8587-457e-8199-dbe22e6766a3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b5d7bd-2d0c-4d08-b070-536c2428935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Volume volume-d9394b35-8587-457e-8199-dbe22e6766a3 (d9394b35-8587-457e-8199-dbe22e6766a3): created successfully
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b5d7bd-2d0c-4d08-b070-536c2428935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Flow 'volume_create_manager' (7ce9bf5b-9a56-4d07-995f-2e4aaaf5f154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:07 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a3fe2c74-42bd-429f-9d5f-a87e89cc9f33 tempest-CinderUnicodeTest-1409970758 None] Created volume successfully.
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Creating offline snapshot 363ac7fd-78bb-4290-b742-6906fe1edd1d of volume d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b97a46-cb25-48cb-9006-b7ddb07ed06e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:07 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3
Sep 12 21:12:07 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:08 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3" returned: 0 in 0.373s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:08 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d 1G
Sep 12 21:12:08 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:08 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d 1G" returned: 0 in 0.416s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9394b35-8587-457e-8199-dbe22e6766a3 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:08 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9394b35-8587-457e-8199-dbe22e6766a3 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d
Sep 12 21:12:08 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:08 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9394b35-8587-457e-8199-dbe22e6766a3 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:08 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d is being set with open permissions: ugo+rw
Sep 12 21:12:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:08 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d
Sep 12 21:12:08 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:09 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:09 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info
Sep 12 21:12:09 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:09 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info" returned: 0 in 0.262s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:09 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info is being set with open permissions: ugo+rw
Sep 12 21:12:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:09 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info
Sep 12 21:12:09 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:09 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.info" returned: 0 in 0.260s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7bd16df3-efe9-4902-ab0d-c9cfa63ff8d8 tempest-CinderUnicodeTest-1409970758 None] Create snapshot completed successfully
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-363ac7fd-78bb-4290-b742-6906fe1edd1d-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-363ac7fd-78bb-4290-b742-6906fe1edd1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-quobyte-d9394b35-8587-457e-8199-dbe22e6766a3" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-d9394b35-8587-457e-8199-dbe22e6766a3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-quobyte-363ac7fd-78bb-4290-b742-6906fe1edd1d" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-363ac7fd-78bb-4290-b742-6906fe1edd1d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Deleting offline snapshot 363ac7fd-78bb-4290-b742-6906fe1edd1d of volume d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] snapshot_file for this snap is: volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[609260bf-5884-42b5-bdca-371c783e98bb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:11 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d
Sep 12 21:12:11 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:11 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d" returned: 0 in 0.386s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9394b35-8587-457e-8199-dbe22e6766a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:12:11 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8702c85-cc13-4b60-8f8e-f07b4d22cd7d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:11 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3
Sep 12 21:12:11 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:11 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3" returned: 0 in 0.358s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:11 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d
Sep 12 21:12:11 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:12 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d" returned: 0 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:12 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d
Sep 12 21:12:12 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:12 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3.363ac7fd-78bb-4290-b742-6906fe1edd1d" returned: 0 in 0.239s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-363ac7fd-78bb-4290-b742-6906fe1edd1d" released by "_delete_snapshot" :: held 1.439s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-d9394b35-8587-457e-8199-dbe22e6766a3" released by "delete_snapshot" :: held 1.464s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Created reservations ['3357a452-4f2d-4db3-a32f-8ce8a744fcf7', '4738ae78-59a7-4c19-a073-b779741d8942', 'c291e46e-bcb6-4a81-be9f-69bacf5d410f', 'e571d3f7-1e97-4454-ac48-f2426c3f8613'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Delete snapshot completed successfully.
Sep 12 21:12:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-74493245-7785-4080-9066-ba1392d0e84b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-363ac7fd-78bb-4290-b742-6906fe1edd1d-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-d9394b35-8587-457e-8199-dbe22e6766a3-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-d9394b35-8587-457e-8199-dbe22e6766a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-quobyte-d9394b35-8587-457e-8199-dbe22e6766a3" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-d9394b35-8587-457e-8199-dbe22e6766a3" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac86874-584f-4b61-af0a-593ddf760085]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:13 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3
Sep 12 21:12:13 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:13 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3" returned: 0 in 0.373s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:13 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3
Sep 12 21:12:13 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:13 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9394b35-8587-457e-8199-dbe22e6766a3" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-d9394b35-8587-457e-8199-dbe22e6766a3" released by "delete_volume" :: held 0.709s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Created reservations ['cc161c25-a187-4ecb-9ff2-08a2461fd664', 'b410d0e1-5331-4e57-b045-b16a06fba3c9', '4566fe9f-24e3-435c-8325-e8c7d6b0bc3b', 'abc1a3ad-f438-4c6f-8286-9711794caa00'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:13 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:13 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:14 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-56b20ddc-020b-4979-9e93-d9dd1f117dc3-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.254s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Deleted volume successfully.
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-56b20ddc-020b-4979-9e93-d9dd1f117dc3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-89535f44-2d95-406c-8c81-0563251fe9f2 tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-d9394b35-8587-457e-8199-dbe22e6766a3-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "cinder-quobyte-56b20ddc-020b-4979-9e93-d9dd1f117dc3" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-56b20ddc-020b-4979-9e93-d9dd1f117dc3" acquired by "delete_volume" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934aa23-3328-4ef4-86b0-8299c72c54c2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:14 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3
Sep 12 21:12:14 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:14 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3" returned: 0 in 0.365s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:14 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3
Sep 12 21:12:14 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:14 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-56b20ddc-020b-4979-9e93-d9dd1f117dc3" returned: 0 in 0.257s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-quobyte-56b20ddc-020b-4979-9e93-d9dd1f117dc3" released by "delete_volume" :: held 0.670s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:14 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Created reservations ['ad79b429-c3cf-428d-b977-ab567860b4a3', 'ec4ae08d-0425-4349-a143-a2205c0c7fb0', '20e2205f-a4eb-43fd-8b30-781555c9cfba', 'ebd1528d-b0c5-42bf-a22d-a38309e95c64'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:15 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:15 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:15 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Deleted volume successfully.
Sep 12 21:12:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cd323db8-a320-488b-bbf8-8e395672af6b tempest-CinderUnicodeTest-1409970758 None] Lock "cinder-56b20ddc-020b-4979-9e93-d9dd1f117dc3-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:25 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=101,cinder:UPDATE=117,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:12:25 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=119,cinder:SELECT=78,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:33 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:33 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:33 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.250s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Flow 'volume_create_manager' (55635c4f-f1bd-45fa-ac8f-533beb056afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0470a067-694c-4d88-b3af-ba6496daabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0470a067-694c-4d88-b3af-ba6496daabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1808065100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acc5ca1-cb9a-4132-be94-0c0ccd5faeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d36d28ec9b45bea46ab3ff7a31cdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:36Z,use_quota=True,user_id='042203bcd5b44c648c8c2ae7433752a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ad7431-292c-4af7-8150-d43fa61fee4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ad7431-292c-4af7-8150-d43fa61fee4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878c83f4-869e-45f9-adf5-642f07259db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878c83f4-869e-45f9-adf5-642f07259db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acc5ca1-cb9a-4132-be94-0c0ccd5faeed', 'volume_name': 'volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4951dcee-4f11-478a-80b9-dddcc8dbc072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4951dcee-4f11-478a-80b9-dddcc8dbc072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f074da4-6e4c-40ac-9156-85566b3e3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:35 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Volume 6acc5ca1-cb9a-4132-be94-0c0ccd5faeed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed', 'volume_size': 1}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1808065100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acc5ca1-cb9a-4132-be94-0c0ccd5faeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d36d28ec9b45bea46ab3ff7a31cdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:36Z,use_quota=True,user_id='042203bcd5b44c648c8c2ae7433752a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Creating volume 6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:12:35 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:12:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:35 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed 1073741824
Sep 12 21:12:35 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:36 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed 1073741824" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:36 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:36 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:36 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.238s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f074da4-6e4c-40ac-9156-85566b3e3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8abbde-5696-4f5b-b4a2-539c766bbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:36 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Volume volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed (6acc5ca1-cb9a-4132-be94-0c0ccd5faeed): created successfully
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8abbde-5696-4f5b-b4a2-539c766bbba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Flow 'volume_create_manager' (55635c4f-f1bd-45fa-ac8f-533beb056afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ea62add8-62bd-4cd7-8191-8b0fb7b55ce6 tempest-SnapshotDependencyTests-1813105087 None] Created volume successfully.
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Creating offline snapshot a53d1cae-cf56-4aa2-ad5e-83deadf51f7e of volume 6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f33709-cbd0-4a87-85f7-ae311aaca12d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:37 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:37 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:37 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:37 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e 1G
Sep 12 21:12:37 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:37 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e 1G" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:37 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e
Sep 12 21:12:37 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:38 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" returned: 0 in 0.283s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:38 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e is being set with open permissions: ugo+rw
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:38 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e
Sep 12 21:12:38 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:38 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" returned: 0 in 0.231s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:38 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info
Sep 12 21:12:38 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:38 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info" returned: 0 in 0.245s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:38 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info is being set with open permissions: ugo+rw
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:38 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info
Sep 12 21:12:38 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:38 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.info" returned: 0 in 0.237s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0716287d-8906-4c36-99ba-89450e05ac40 tempest-SnapshotDependencyTests-1813105087 None] Create snapshot completed successfully
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Flow 'volume_create_manager' (8272d57e-bfe0-465f-8384-8ba27830961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2514381-bee5-42c7-bc6a-3c4a4ab7ac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2514381-bee5-42c7-bc6a-3c4a4ab7ac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb3ccd9-ef51-4801-be60-193087b36853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d36d28ec9b45bea46ab3ff7a31cdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a53d1cae-cf56-4aa2-ad5e-83deadf51f7e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:12:40Z,use_quota=True,user_id='042203bcd5b44c648c8c2ae7433752a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3fa116-0ff1-4672-b997-fb3ac3f1a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3fa116-0ff1-4672-b997-fb3ac3f1a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b85cf72-d50a-4bbd-bd13-5712b037c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b85cf72-d50a-4bbd-bd13-5712b037c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fb3ccd9-ef51-4801-be60-193087b36853', 'volume_name': 'volume-1fb3ccd9-ef51-4801-be60-193087b36853', 'volume_size': 1, 'snapshot_id': 'a53d1cae-cf56-4aa2-ad5e-83deadf51f7e'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43104955-7771-4f31-9abb-92c952bb0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43104955-7771-4f31-9abb-92c952bb0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d211ff06-7734-4c02-98af-fb26163cdfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Volume 1fb3ccd9-ef51-4801-be60-193087b36853: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fb3ccd9-ef51-4801-be60-193087b36853', 'volume_size': 1, 'snapshot_id': 'a53d1cae-cf56-4aa2-ad5e-83deadf51f7e'}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-quobyte-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e-1fb3ccd9-ef51-4801-be60-193087b36853" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e-1fb3ccd9-ef51-4801-be60-193087b36853" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Creating volume 1fb3ccd9-ef51-4801-be60-193087b36853 from snapshot a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-quobyte-1fb3ccd9-ef51-4801-be60-193087b36853" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-1fb3ccd9-ef51-4801-be60-193087b36853" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] snapshot: a53d1cae-cf56-4aa2-ad5e-83deadf51f7e, volume: 1fb3ccd9-ef51-4801-be60-193087b36853,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d45e276-47ea-4a74-92b6-8bf77582d00a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:39 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e
Sep 12 21:12:39 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:40 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a7b7e-34f2-48eb-9edd-89ffb458a960]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:40 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:40 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:40 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.349s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:12:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:40 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853
Sep 12 21:12:40 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:44 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853" returned: 0 in 4.048s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:44 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5383a7ed-5cf7-45c8-908e-d63a32b2edf9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:44 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:44 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:45 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.551s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:12:45 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Converted 1024.00 MB image at 252.91 MB/s
Sep 12 21:12:45 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 is being set with open permissions: ugo+rw
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:45 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853
Sep 12 21:12:45 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:45 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853" returned: 0 in 0.238s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-1fb3ccd9-ef51-4801-be60-193087b36853" released by "_copy_volume_from_snapshot" :: held 5.617s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e-1fb3ccd9-ef51-4801-be60-193087b36853" released by "_create_volume_from_snapshot" :: held 5.643s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.657s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d211ff06-7734-4c02-98af-fb26163cdfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb3ccd9-ef51-4801-be60-193087b36853', 'volume_size': 1, 'snapshot_id': 'a53d1cae-cf56-4aa2-ad5e-83deadf51f7e'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53a9676-1891-46dd-940a-2324c30f4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:12:45 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Volume volume-1fb3ccd9-ef51-4801-be60-193087b36853 (1fb3ccd9-ef51-4801-be60-193087b36853): created successfully
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53a9676-1891-46dd-940a-2324c30f4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:12:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Flow 'volume_create_manager' (8272d57e-bfe0-465f-8384-8ba27830961c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:12:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ec9ab1ea-562e-4fd7-bb4c-d94deffe92c5 tempest-SnapshotDependencyTests-1813105087 None] Created volume successfully.
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-quobyte-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-quobyte-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Deleting offline snapshot a53d1cae-cf56-4aa2-ad5e-83deadf51f7e of volume 6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] snapshot_file for this snap is: volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c6373f-b297-4435-aa45-d12cc745a30d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:46 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e
Sep 12 21:12:46 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:46 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" returned: 0 in 0.346s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b66cd-f955-4b4a-9b36-4983db3ef700]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:46 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:46 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:46 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.348s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:46 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e
Sep 12 21:12:46 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:47 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" returned: 0 in 0.320s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:47 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e
Sep 12 21:12:47 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:47 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed.a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" returned: 0 in 0.237s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e" released by "_delete_snapshot" :: held 1.334s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" released by "delete_snapshot" :: held 1.360s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Created reservations ['823b90ac-cfff-433e-8f45-d63a6c643c86', '7535036a-cfd8-4f8f-8089-abcf7a1f0c57', 'ad924d01-437e-4d34-a371-f9aadefec02b', 'f8908bd5-894d-498e-9f5e-27ff86f4a458'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Delete snapshot completed successfully.
Sep 12 21:12:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-51ec664d-246e-4354-b8ce-1bb75503ea4f tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-a53d1cae-cf56-4aa2-ad5e-83deadf51f7e-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-quobyte-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" acquired by "delete_volume" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6364bbc-29a3-4c2d-a461-0782d62983e7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:48 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:48 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:48 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.347s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:48 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed
Sep 12 21:12:48 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:48 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" returned: 0 in 0.244s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed" released by "delete_volume" :: held 0.643s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Created reservations ['8cb5d13c-bf0e-445e-864a-7aab10c7dfe4', '821a2881-7e7a-4323-8f9d-bf73f3f01f41', '37ac2d7c-9b42-41a2-a651-83ddacaf62f4', '99553136-2ecf-4dea-9d9d-636774cc1b12'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:49 devstack sudo[107473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:49 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:49 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.239s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Deleted volume successfully.
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-370a1959-adba-4340-929e-999e2b4c35ae tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-6acc5ca1-cb9a-4132-be94-0c0ccd5faeed-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-1fb3ccd9-ef51-4801-be60-193087b36853-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-1fb3ccd9-ef51-4801-be60-193087b36853-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "cinder-quobyte-1fb3ccd9-ef51-4801-be60-193087b36853" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-1fb3ccd9-ef51-4801-be60-193087b36853" acquired by "delete_volume" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2331f4-3981-4bbd-9f7e-958ad76afd30]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:49 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853
Sep 12 21:12:49 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:49 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853" returned: 0 in 0.351s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:49 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853
Sep 12 21:12:49 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:50 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1fb3ccd9-ef51-4801-be60-193087b36853" returned: 0 in 0.243s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-quobyte-1fb3ccd9-ef51-4801-be60-193087b36853" released by "delete_volume" :: held 0.630s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Created reservations ['6dd263ba-a560-4d81-aa4a-43481bf6ffd0', '932b5e80-52a1-4644-bb0f-57754fc14cca', 'df148555-f797-4d2c-8e87-5643e3a05f5e', '86992383-8eb8-4c17-8f48-e6cb86b4055c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:12:50 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:12:50 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:12:50 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.238s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:12:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Deleted volume successfully.
Sep 12 21:12:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-387e89b2-6d31-4501-9e48-ced1151a1eb9 tempest-SnapshotDependencyTests-1813105087 None] Lock "cinder-1fb3ccd9-ef51-4801-be60-193087b36853-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:00 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=23,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:13:00 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=30,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Flow 'volume_create_manager' (d182a9da-73ac-4fd8-9a9f-e9fae4d5e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30f1eb-1175-42a3-9ab7-75eea16e2ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30f1eb-1175-42a3-9ab7-75eea16e2ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff54fdcff5a94e9fa874150e548d6a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:10Z,use_quota=True,user_id='bb83bdecc1734ebc9afdbf8b6114f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aece24a1-b70e-424e-9ed2-1b35dcadb620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aece24a1-b70e-424e-9ed2-1b35dcadb620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8551bc53-e6b8-4684-840e-2e6f5a06d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8551bc53-e6b8-4684-840e-2e6f5a06d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12', 'volume_name': 'volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5c0118-deb1-4347-8b22-188c5674f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5c0118-deb1-4347-8b22-188c5674f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ac827f-7fb1-4f79-94c5-853cced2a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Volume a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12', 'volume_size': 1}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff54fdcff5a94e9fa874150e548d6a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:10Z,use_quota=True,user_id='bb83bdecc1734ebc9afdbf8b6114f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Creating volume a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:10 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:10 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 1073741824
Sep 12 21:13:10 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (9e1899b8-8b8a-46a2-8587-57e0f3464508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ba608f-032e-4ebb-b09e-ba614daf129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ba608f-032e-4ebb-b09e-ba614daf129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872686984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4db686-6d22-43f6-b56c-1d2f315fb1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:10Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d78644d-f5e4-41d5-8731-a523a6e1b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d78644d-f5e4-41d5-8731-a523a6e1b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab4dc5e-d53c-43e0-ba6b-a34a99b16e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab4dc5e-d53c-43e0-ba6b-a34a99b16e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4db686-6d22-43f6-b56c-1d2f315fb1ae', 'volume_name': 'volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec2b0fb-062e-4a3b-85cb-7d540107b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec2b0fb-062e-4a3b-85cb-7d540107b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c879a44-6374-4bd7-99cd-5f76c28b3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume 0d4db686-6d22-43f6-b56c-1d2f315fb1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae', 'volume_size': 1}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Flow 'volume_create_manager' (3cf9e7af-35ce-41f7-99c8-3d2a6b731f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c240f1f-1f83-46f2-ba27-43a5b84c6d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c240f1f-1f83-46f2-ba27-43a5b84c6d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1318205832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159057dd-675d-41e1-80f1-bc27250bbb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f832f7c1743d4509a76779ac3a3a4fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:11Z,use_quota=True,user_id='c653f80fb1e64199ad38ce03eb29b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1b3254-ec20-47b8-b337-7f5e081246a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1b3254-ec20-47b8-b337-7f5e081246a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b864a98-c547-4929-ada7-74c64ab806bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b864a98-c547-4929-ada7-74c64ab806bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159057dd-675d-41e1-80f1-bc27250bbb4b', 'volume_name': 'volume-159057dd-675d-41e1-80f1-bc27250bbb4b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db01c53-ad29-4e6f-a2bb-941e28c47c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db01c53-ad29-4e6f-a2bb-941e28c47c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8727a78-7562-4aef-b06c-f93efdbf766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Volume 159057dd-675d-41e1-80f1-bc27250bbb4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159057dd-675d-41e1-80f1-bc27250bbb4b', 'volume_size': 1}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 1073741824" returned: 0 in 0.586s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:11 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12
Sep 12 21:13:11 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:11 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12" returned: 0 in 0.257s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872686984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4db686-6d22-43f6-b56c-1d2f315fb1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:10Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Creating volume 0d4db686-6d22-43f6-b56c-1d2f315fb1ae {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:11 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ac827f-7fb1-4f79-94c5-853cced2a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:11 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae 1073741824
Sep 12 21:13:11 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e841f24-d01a-46a2-aaa9-38d1865d4409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:11 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Volume volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 (a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12): created successfully
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e841f24-d01a-46a2-aaa9-38d1865d4409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Flow 'volume_create_manager' (d182a9da-73ac-4fd8-9a9f-e9fae4d5e4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4652bb6a-fa03-4e26-8024-6502733f8219 tempest-CinderUnicodeTest-880865727 None] Created volume successfully.
Sep 12 21:13:11 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae 1073741824" returned: 0 in 0.427s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:11 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae
Sep 12 21:13:11 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:11 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1318205832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159057dd-675d-41e1-80f1-bc27250bbb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f832f7c1743d4509a76779ac3a3a4fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:11Z,use_quota=True,user_id='c653f80fb1e64199ad38ce03eb29b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Creating volume 159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:12 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c879a44-6374-4bd7-99cd-5f76c28b3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:12 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b 1073741824
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c302ac-3fcc-4c4a-aa60-084b081a95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:12 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:12 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae (0d4db686-6d22-43f6-b56c-1d2f315fb1ae): created successfully
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c302ac-3fcc-4c4a-aa60-084b081a95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (9e1899b8-8b8a-46a2-8587-57e0f3464508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7ee591d5-80ea-4e15-896d-b0bed3e5d806 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created volume successfully.
Sep 12 21:13:12 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b 1073741824" returned: 0 in 0.586s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:12 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:12 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:12 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8727a78-7562-4aef-b06c-f93efdbf766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159057dd-675d-41e1-80f1-bc27250bbb4b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f9f23a-27d6-46e2-9203-3c6b7b2abf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Volume volume-159057dd-675d-41e1-80f1-bc27250bbb4b (159057dd-675d-41e1-80f1-bc27250bbb4b): created successfully
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f9f23a-27d6-46e2-9203-3c6b7b2abf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Flow 'volume_create_manager' (3cf9e7af-35ce-41f7-99c8-3d2a6b731f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-349cabe0-c7ec-49f3-aeab-62aa957317f6 tempest-VolumeDependencyTests-658882148 None] Created volume successfully.
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Flow 'volume_create_manager' (04a21a58-ab85-42f8-8b7c-7f0f4e8d7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9f1612-0beb-4e5d-b59e-62fb2c18d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9f1612-0beb-4e5d-b59e-62fb2c18d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-817108533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127a7e84-9f81-42b4-a126-82a5880df773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff54fdcff5a94e9fa874150e548d6a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:13Z,use_quota=True,user_id='bb83bdecc1734ebc9afdbf8b6114f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57275b91-7ac4-4254-b6e9-88b28c4fb6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57275b91-7ac4-4254-b6e9-88b28c4fb6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e189cd-0814-4054-a164-7cb298b5a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e189cd-0814-4054-a164-7cb298b5a80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127a7e84-9f81-42b4-a126-82a5880df773', 'volume_name': 'volume-127a7e84-9f81-42b4-a126-82a5880df773', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ff0494-151b-4bb8-bb28-bf782e2a5e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ff0494-151b-4bb8-bb28-bf782e2a5e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ec33e-2a6a-4464-a9a9-256a92cdeb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Volume 127a7e84-9f81-42b4-a126-82a5880df773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127a7e84-9f81-42b4-a126-82a5880df773', 'volume_size': 1}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-817108533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127a7e84-9f81-42b4-a126-82a5880df773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff54fdcff5a94e9fa874150e548d6a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:13Z,use_quota=True,user_id='bb83bdecc1734ebc9afdbf8b6114f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Creating volume 127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:13 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:13 devstack sudo[107598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 1073741824
Sep 12 21:13:13 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (486ca8dd-9d5e-476b-a5d7-d3bd3834ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73452586-1a40-4be2-826d-03ad0c4615bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73452586-1a40-4be2-826d-03ad0c4615bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544302053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b1d5f5-82fb-4555-b957-2fac95181667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:13Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e88e71-5f6e-441f-8ee8-aae495f0646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e88e71-5f6e-441f-8ee8-aae495f0646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df399d1b-8c4b-4b84-a3a1-f1cce6b5c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df399d1b-8c4b-4b84-a3a1-f1cce6b5c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b1d5f5-82fb-4555-b957-2fac95181667', 'volume_name': 'volume-09b1d5f5-82fb-4555-b957-2fac95181667', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e3d1b8-c028-4ab1-bd2f-eac0deaa211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e3d1b8-c028-4ab1-bd2f-eac0deaa211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d14f9fd-69a7-4ff4-b05c-558ff01440d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume 09b1d5f5-82fb-4555-b957-2fac95181667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b1d5f5-82fb-4555-b957-2fac95181667', 'volume_size': 1}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (7c473f14-b297-4258-8e70-5fa468050d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39bbfc2-4b87-4efe-8c99-aef90ec1c14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39bbfc2-4b87-4efe-8c99-aef90ec1c14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009622248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2f5262-75f9-48c2-8625-4b22262699db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:13Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd1e30-4847-45d8-b4a6-d625394b9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd1e30-4847-45d8-b4a6-d625394b9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fb36f8-918c-4948-ad53-87d06c63855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fb36f8-918c-4948-ad53-87d06c63855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2f5262-75f9-48c2-8625-4b22262699db', 'volume_name': 'volume-7a2f5262-75f9-48c2-8625-4b22262699db', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1927710-3b8b-467c-9a6c-0bbf4f2265bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1927710-3b8b-467c-9a6c-0bbf4f2265bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c2bf76-497f-4a4d-a609-5dd89031eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume 7a2f5262-75f9-48c2-8625-4b22262699db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2f5262-75f9-48c2-8625-4b22262699db', 'volume_size': 1}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:13 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 1073741824" returned: 0 in 0.590s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (6acbe5c8-00ad-484d-afd5-9b0f610bc86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e226f29-c28b-4ee4-8270-d0317a583419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e226f29-c28b-4ee4-8270-d0317a583419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693607941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a555e310-ad73-465a-a176-3ed95021ebd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:14Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b094994-d932-4706-a3cf-b354dfdcf46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b094994-d932-4706-a3cf-b354dfdcf46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd285be-4fe3-4605-9cad-ccfe8488fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd285be-4fe3-4605-9cad-ccfe8488fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a555e310-ad73-465a-a176-3ed95021ebd4', 'volume_name': 'volume-a555e310-ad73-465a-a176-3ed95021ebd4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fcb81d-8187-4005-a1a9-231a6abc2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fcb81d-8187-4005-a1a9-231a6abc2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789fe5f0-5f30-4c31-bf77-162a6543596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume a555e310-ad73-465a-a176-3ed95021ebd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a555e310-ad73-465a-a176-3ed95021ebd4', 'volume_size': 1}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:14 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773
Sep 12 21:13:14 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:14 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773" returned: 0 in 0.340s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544302053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b1d5f5-82fb-4555-b957-2fac95181667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:13Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Creating volume 09b1d5f5-82fb-4555-b957-2fac95181667 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:14 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ec33e-2a6a-4464-a9a9-256a92cdeb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127a7e84-9f81-42b4-a126-82a5880df773', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d1c2fd-6fdd-45ed-bbbd-1dbafb5cc0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667 1073741824
Sep 12 21:13:14 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Volume volume-127a7e84-9f81-42b4-a126-82a5880df773 (127a7e84-9f81-42b4-a126-82a5880df773): created successfully
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d1c2fd-6fdd-45ed-bbbd-1dbafb5cc0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Flow 'volume_create_manager' (04a21a58-ab85-42f8-8b7c-7f0f4e8d7652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:14 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-330a8ee8-a4ab-4383-8234-4b564490802d tempest-CinderUnicodeTest-880865727 None] Created volume successfully.
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (b0fd302a-f592-4740-aa20-02113bad7370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19848c04-aa7e-42c8-8106-e6d8b93bb314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19848c04-aa7e-42c8-8106-e6d8b93bb314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933155405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ba2785-262a-46b8-9969-1fdf1e999d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:15Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b34012c-887a-428a-95c4-909f1c649086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b34012c-887a-428a-95c4-909f1c649086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0198d8b1-b919-43cb-9f80-a2bae8332adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0198d8b1-b919-43cb-9f80-a2bae8332adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ba2785-262a-46b8-9969-1fdf1e999d46', 'volume_name': 'volume-a6ba2785-262a-46b8-9969-1fdf1e999d46', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc67b9c5-50a2-46f5-a85c-27a172608481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc67b9c5-50a2-46f5-a85c-27a172608481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c36adb-59fe-4387-aca4-5dc525b7b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume a6ba2785-262a-46b8-9969-1fdf1e999d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ba2785-262a-46b8-9969-1fdf1e999d46', 'volume_size': 1}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Flow 'volume_create_manager' (d6ad2ae0-4708-4c26-a83e-65798ac0417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:14 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b164bcf4-1391-4c26-80f6-f351dfd7b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667 1073741824" returned: 0 in 0.573s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:14 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b164bcf4-1391-4c26-80f6-f351dfd7b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcfaff0-6ea2-43b7-abf4-7311460c32a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328a01f96a2d4b0eb1a5de16ad0e4d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:15Z,use_quota=True,user_id='c54b2ec95b6c43bfaf7594a8c8ebaf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b676d200-723a-4fc4-aaaa-cbda8d994745),volume_type_id=b676d200-723a-4fc4-aaaa-cbda8d994745)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80668d1b-9c59-4d81-97ce-3e6ea3b5de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80668d1b-9c59-4d81-97ce-3e6ea3b5de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d539858-307c-4ccb-8fd5-2018a2a82695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (0290be02-e560-4bba-8f1a-a6a0ca5f95fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4899ba04-c4c3-45e6-8291-7b3f3c269884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4899ba04-c4c3-45e6-8291-7b3f3c269884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622528080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c04a0f-6da7-4fee-990b-d516cbdae9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:15Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667
Sep 12 21:13:15 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28650f61-58ab-46f8-8b59-477cd498b0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28650f61-58ab-46f8-8b59-477cd498b0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce71989-c402-4fd8-bb4a-faf4e7bcdec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce71989-c402-4fd8-bb4a-faf4e7bcdec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c04a0f-6da7-4fee-990b-d516cbdae9cb', 'volume_name': 'volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f759dbac-5f92-45a9-9c08-4514de244d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f759dbac-5f92-45a9-9c08-4514de244d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20843666-04d2-462b-93ff-366f4d604f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume 90c04a0f-6da7-4fee-990b-d516cbdae9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb', 'volume_size': 1}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:15 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667" returned: 0 in 0.289s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.712s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009622248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2f5262-75f9-48c2-8625-4b22262699db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:13Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Creating volume 7a2f5262-75f9-48c2-8625-4b22262699db {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:15 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d539858-307c-4ccb-8fd5-2018a2a82695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdcfaff0-6ea2-43b7-abf4-7311460c32a3', 'volume_name': 'volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3', 'volume_size': 1, 'image_id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fce0f1c6c34dd06a9688b4df60a83e5f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '328a01f96a2d4b0eb1a5de16ad0e4d67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b214dda9932dbf111ff29dc8e33045779bcc2233e7253938a9acd0a7441564b8c49367df425c2b13e600525b160254a03894e72fa33253e621281a916f70396b', 'id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'created_at': datetime.datetime(2026, 9, 12, 19, 13, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 13, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056ce8f50>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d4d707-6a36-4a40-8638-846de98caa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db 1073741824
Sep 12 21:13:15 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d4d707-6a36-4a40-8638-846de98caa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbe2bd0-8b89-4e4c-85db-853d1609849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Volume cdcfaff0-6ea2-43b7-abf4-7311460c32a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3', 'volume_size': 1, 'image_id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fce0f1c6c34dd06a9688b4df60a83e5f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '328a01f96a2d4b0eb1a5de16ad0e4d67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b214dda9932dbf111ff29dc8e33045779bcc2233e7253938a9acd0a7441564b8c49367df425c2b13e600525b160254a03894e72fa33253e621281a916f70396b', 'id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'created_at': datetime.datetime(2026, 9, 12, 19, 13, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 13, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056ce8f50>}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Trying to clone cdcfaff0-6ea2-43b7-abf4-7311460c32a3 from image 3b45bfdc-551e-434e-828d-6faaa1a4cfac at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d14f9fd-69a7-4ff4-b05c-558ff01440d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b1d5f5-82fb-4555-b957-2fac95181667', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca470114-84f5-432f-a70d-ec29df768f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:15 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume volume-09b1d5f5-82fb-4555-b957-2fac95181667 (09b1d5f5-82fb-4555-b957-2fac95181667): created successfully
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca470114-84f5-432f-a70d-ec29df768f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (486ca8dd-9d5e-476b-a5d7-d3bd3834ff81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-98dfeb64-2789-4466-a2e1-969d0dc38f6d tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created volume successfully.
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:13:15 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Image download 0.00 MB at 0.00 MB/s
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eea325-b3f6-49fa-8b5f-fe2dde8a08dd]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:15 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD
Sep 12 21:13:15 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:15 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db 1073741824" returned: 0 in 0.484s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:15 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db
Sep 12 21:13:15 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:15 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:16 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD
Sep 12 21:13:16 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:16 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db" returned: 0 in 0.248s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693607941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a555e310-ad73-465a-a176-3ed95021ebd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:14Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Creating volume a555e310-ad73-465a-a176-3ed95021ebd4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:16 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c2bf76-497f-4a4d-a609-5dd89031eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2f5262-75f9-48c2-8625-4b22262699db', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:16 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4 1073741824
Sep 12 21:13:16 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac41cc03-0d13-44d0-9671-c4825bc800e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume volume-7a2f5262-75f9-48c2-8625-4b22262699db (7a2f5262-75f9-48c2-8625-4b22262699db): created successfully
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac41cc03-0d13-44d0-9671-c4825bc800e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (7c473f14-b297-4258-8e70-5fa468050d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0c63b17a-9c6e-4951-a02a-8b7607d03c16 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created volume successfully.
Sep 12 21:13:16 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Temporary image 3b45bfdc-551e-434e-828d-6faaa1a4cfac is fetched for user c54b2ec95b6c43bfaf7594a8c8ebaf71. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14015f-2ceb-40fb-86eb-6578599c38cb]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:16 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD
Sep 12 21:13:16 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:16 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4 1073741824" returned: 0 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:16 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4
Sep 12 21:13:16 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:16 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:16 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD
Sep 12 21:13:16 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:16 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4" returned: 0 in 0.261s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933155405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ba2785-262a-46b8-9969-1fdf1e999d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:15Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Creating volume a6ba2785-262a-46b8-9969-1fdf1e999d46 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:16 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789fe5f0-5f30-4c31-bf77-162a6543596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a555e310-ad73-465a-a176-3ed95021ebd4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cdd4e7-e6a8-4504-9733-bd6ee8b83e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:16 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 1073741824
Sep 12 21:13:16 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume volume-a555e310-ad73-465a-a176-3ed95021ebd4 (a555e310-ad73-465a-a176-3ed95021ebd4): created successfully
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cdd4e7-e6a8-4504-9733-bd6ee8b83e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (6acbe5c8-00ad-484d-afd5-9b0f610bc86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c636b4df-e3c7-4201-86b0-3927d83dd152 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created volume successfully.
Sep 12 21:13:17 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:17 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 1073741824" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:17 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46
Sep 12 21:13:17 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:17 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46" returned: 0 in 0.251s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.716s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Creating offline snapshot 6ca7de79-b01b-4380-8d40-dc31caf6357b of volume 159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c36adb-59fe-4387-aca4-5dc525b7b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ba2785-262a-46b8-9969-1fdf1e999d46', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919f0632-f461-4a90-8536-9b24bddd843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f7c90f-7e45-412c-92f3-95221aab5c64]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:17 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 (a6ba2785-262a-46b8-9969-1fdf1e999d46): created successfully
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919f0632-f461-4a90-8536-9b24bddd843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:17 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (b0fd302a-f592-4740-aa20-02113bad7370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:17 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f69f9d74-22f5-444b-b2e0-5f4540309411 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created volume successfully.
Sep 12 21:13:17 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:17 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:18 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:18 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b 1G
Sep 12 21:13:18 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:18 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b 1G" returned: 0 in 0.392s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159057dd-675d-41e1-80f1-bc27250bbb4b -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:18 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159057dd-675d-41e1-80f1-bc27250bbb4b -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b
Sep 12 21:13:18 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:18 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159057dd-675d-41e1-80f1-bc27250bbb4b -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b" returned: 0 in 0.298s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:18 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b is being set with open permissions: ugo+rw
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:18 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b
Sep 12 21:13:18 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:18 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b" returned: 0 in 0.240s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:19 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info
Sep 12 21:13:19 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:19 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:19 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info is being set with open permissions: ugo+rw
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:19 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info
Sep 12 21:13:19 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:19 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.info" returned: 0 in 0.242s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.389s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622528080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c04a0f-6da7-4fee-990b-d516cbdae9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c76b584b9f42d4a2562b55c67e4af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:15Z,use_quota=True,user_id='fe31903cac9648a583f3b2e50d2f1d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Creating volume 90c04a0f-6da7-4fee-990b-d516cbdae9cb {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:19 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:19 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb 1073741824
Sep 12 21:13:19 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-be6a98ee-2b85-4755-a5a1-4e16aabc9028 tempest-VolumeDependencyTests-658882148 None] Create snapshot completed successfully
Sep 12 21:13:19 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb 1073741824" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:20 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb
Sep 12 21:13:20 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:20 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb" returned: 0 in 0.255s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.692s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20843666-04d2-462b-93ff-366f4d604f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beea22e-a750-4fa6-a193-e8524cd990f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Creating offline snapshot 8b50e050-a517-4693-bfc4-7defb46fdef2 of volume 127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:13:20 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Volume volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb (90c04a0f-6da7-4fee-990b-d516cbdae9cb): created successfully
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beea22e-a750-4fa6-a193-e8524cd990f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Flow 'volume_create_manager' (0290be02-e560-4bba-8f1a-a6a0ca5f95fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c536c9-7bb9-4c0d-b1c2-68789f6cdb64]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b03a5913-f0e4-4db9-8b26-2383334f00b9 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created volume successfully.
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Flow 'volume_create_manager' (963823fb-f453-4082-a9d6-e07136d50a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe57734-2151-4547-92a2-a47e8301766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe57734-2151-4547-92a2-a47e8301766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-136013399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3410ec10-7aa4-425d-843e-3dfcd7ef3da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f832f7c1743d4509a76779ac3a3a4fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ca7de79-b01b-4380-8d40-dc31caf6357b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:20Z,use_quota=True,user_id='c653f80fb1e64199ad38ce03eb29b4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a956f1-0c47-43d1-9b88-e549c59101f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a956f1-0c47-43d1-9b88-e549c59101f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11518f0-1b82-430a-a607-9d470ca46fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:20 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773
Sep 12 21:13:20 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11518f0-1b82-430a-a607-9d470ca46fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3410ec10-7aa4-425d-843e-3dfcd7ef3da7', 'volume_name': 'volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7', 'volume_size': 1, 'snapshot_id': '6ca7de79-b01b-4380-8d40-dc31caf6357b'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1259111e-d694-4d6c-a877-1ba0ad9b8452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1259111e-d694-4d6c-a877-1ba0ad9b8452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e0123f-e08e-495c-834d-0772a7bc9952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:20 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Volume 3410ec10-7aa4-425d-843e-3dfcd7ef3da7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7', 'volume_size': 1, 'snapshot_id': '6ca7de79-b01b-4380-8d40-dc31caf6357b'}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:20 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:20 devstack sudo[107705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 1G
Sep 12 21:13:20 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:21 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 1G" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-127a7e84-9f81-42b4-a126-82a5880df773 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:21 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-127a7e84-9f81-42b4-a126-82a5880df773 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2
Sep 12 21:13:21 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:21 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-127a7e84-9f81-42b4-a126-82a5880df773 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2" returned: 0 in 0.303s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:21 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 is being set with open permissions: ugo+rw
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-90c04a0f-6da7-4fee-990b-d516cbdae9cb-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:21 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2
Sep 12 21:13:21 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-90c04a0f-6da7-4fee-990b-d516cbdae9cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-quobyte-90c04a0f-6da7-4fee-990b-d516cbdae9cb" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-90c04a0f-6da7-4fee-990b-d516cbdae9cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eeac73-89ab-4904-a87e-832e99279322]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:21 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb
Sep 12 21:13:21 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:21 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2" returned: 0 in 0.261s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:21 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info
Sep 12 21:13:21 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:21 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:21 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb
Sep 12 21:13:21 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:22 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:22 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info is being set with open permissions: ugo+rw
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:22 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info
Sep 12 21:13:22 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:22 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-90c04a0f-6da7-4fee-990b-d516cbdae9cb" returned: 0 in 0.250s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-90c04a0f-6da7-4fee-990b-d516cbdae9cb" released by "delete_volume" :: held 0.671s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created reservations ['dacdf8e6-28cd-416f-b592-0aeba4f9dbaa', '132b4b9e-79d6-4e4a-b242-8566bd4572a3', '55cbf53f-4440-4bcb-9e5b-ce924b25cbc7', '00b72874-9bd8-4922-becd-4217b03f15bf'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:22 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.info" returned: 0 in 0.267s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.144s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcfaff0-6ea2-43b7-abf4-7311460c32a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='328a01f96a2d4b0eb1a5de16ad0e4d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:15Z,use_quota=True,user_id='c54b2ec95b6c43bfaf7594a8c8ebaf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b676d200-723a-4fc4-aaaa-cbda8d994745),volume_type_id=b676d200-723a-4fc4-aaaa-cbda8d994745)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Creating volume cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:22 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:22 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 1073741824
Sep 12 21:13:22 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-3df21ae3-ca63-4e82-b7f4-147d5659da30 tempest-CinderUnicodeTest-880865727 None] Create snapshot completed successfully
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:22 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:22 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-a6ba2785-262a-46b8-9969-1fdf1e999d46-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-a6ba2785-262a-46b8-9969-1fdf1e999d46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:22 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Deleted volume successfully.
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-quobyte-a6ba2785-262a-46b8-9969-1fdf1e999d46" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-aca013d1-4fe0-4f92-ac2f-51accdd01586 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-90c04a0f-6da7-4fee-990b-d516cbdae9cb-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-a6ba2785-262a-46b8-9969-1fdf1e999d46" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[34031e21-c433-4486-b1bf-281d4712b88a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:22 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:22 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46
Sep 12 21:13:22 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 1073741824" returned: 0 in 0.555s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-8b50e050-a517-4693-bfc4-7defb46fdef2-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-8b50e050-a517-4693-bfc4-7defb46fdef2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-quobyte-127a7e84-9f81-42b4-a126-82a5880df773" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-127a7e84-9f81-42b4-a126-82a5880df773" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-quobyte-8b50e050-a517-4693-bfc4-7defb46fdef2" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-8b50e050-a517-4693-bfc4-7defb46fdef2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Deleting offline snapshot 8b50e050-a517-4693-bfc4-7defb46fdef2 of volume 127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:13:22 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:22 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] snapshot_file for this snap is: volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[51501984-969d-4a49-b21e-395c586a373c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2
Sep 12 21:13:23 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:23 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46
Sep 12 21:13:23 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:23 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 0 in 0.297s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.718s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-quobyte-6ca7de79-b01b-4380-8d40-dc31caf6357b-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-6ca7de79-b01b-4380-8d40-dc31caf6357b-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Creating volume 3410ec10-7aa4-425d-843e-3dfcd7ef3da7 from snapshot 6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-quobyte-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Attempting download of 3b45bfdc-551e-434e-828d-6faaa1a4cfac ((None, [{'url': 'file:///opt/stack/data/glance/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'metadata': {}}])) to volume cdcfaff0-6ea2-43b7-abf4-7311460c32a3. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] snapshot: 6ca7de79-b01b-4380-8d40-dc31caf6357b, volume: 3410ec10-7aa4-425d-843e-3dfcd7ef3da7,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2b3da4-ff70-4fc0-ba37-5ef17a793666]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb83a443-d464-422f-8cf8-97120aca5a1f]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_ {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2" returned: 0 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-127a7e84-9f81-42b4-a126-82a5880df773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[18668376-8303-49e4-b6db-82db3bae0411]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a6ba2785-262a-46b8-9969-1fdf1e999d46" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-a6ba2785-262a-46b8-9969-1fdf1e999d46" released by "delete_volume" :: held 0.819s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:23 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_
Sep 12 21:13:23 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:23 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b
Sep 12 21:13:23 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created reservations ['3677407f-dab5-48e7-a63f-72c961627871', 'df99af88-586f-4457-b19a-5b1da2f4d790', 'e77ad30a-30a3-4012-83cf-51dd527d8c8a', '1447ad7b-576b-4e45-b477-41baa757933d'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:23 devstack sudo[107761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773
Sep 12 21:13:23 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:23 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-a555e310-ad73-465a-a176-3ed95021ebd4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:23 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_" returned: 0 in 0.481s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_ {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-a555e310-ad73-465a-a176-3ed95021ebd4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-quobyte-a555e310-ad73-465a-a176-3ed95021ebd4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-a555e310-ad73-465a-a176-3ed95021ebd4" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:23 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b" returned: 0 in 0.620s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773" returned: 0 in 0.518s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159057dd-675d-41e1-80f1-bc27250bbb4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:13:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c9ae12-a3aa-4262-8b0d-b4cef5dfc189]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d6689-4197-4525-bad1-c15a71a0e50c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2
Sep 12 21:13:24 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_
Sep 12 21:13:24 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.440s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:24 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4
Sep 12 21:13:24 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Deleted volume successfully.
Sep 12 21:13:24 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:24 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1624f211-cbaf-4f9b-9166-4cdf689c9e3e tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-a6ba2785-262a-46b8-9969-1fdf1e999d46-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:24 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_" returned: 1 in 0.439s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b45bfdc-551e-434e-828d-6faaa1a4cfac_3hzxvdk_' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca0182d-58d0-477e-96d3-2594f82eebc7]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2" returned: 0 in 0.447s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD
Sep 12 21:13:24 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4
Sep 12 21:13:24 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack sudo[107801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2
Sep 12 21:13:24 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.493s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7
Sep 12 21:13:24 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a555e310-ad73-465a-a176-3ed95021ebd4" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-a555e310-ad73-465a-a176-3ed95021ebd4" released by "delete_volume" :: held 0.752s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:24 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773.8b50e050-a517-4693-bfc4-7defb46fdef2" returned: 0 in 0.293s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-8b50e050-a517-4693-bfc4-7defb46fdef2" released by "_delete_snapshot" :: held 1.850s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-127a7e84-9f81-42b4-a126-82a5880df773" released by "delete_snapshot" :: held 1.876s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created reservations ['0f5eb6df-8c8e-415e-8805-30e2b09858ff', '880fc592-a77b-4484-8f25-03d85e77a915', 'c714adc0-185e-42d8-8258-ee493ae4ab92', '6c49fe13-1cbc-4353-a314-19116d036faa'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:24 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD
Sep 12 21:13:24 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Created reservations ['2bb31fae-279f-4ee0-8709-c8d38ec982dc', 'b278b5fb-4b73-4c45-a9c9-7bd9b6de6c8a', '63e4f2a8-6e3d-437e-b270-7275b69834b3', '8dd9c37d-9598-49af-a849-6a6d22775069'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:25 devstack sudo[107815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:25 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Delete snapshot completed successfully.
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1ac07c4d-d661-4d79-89fd-1c4b56fc5993 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-8b50e050-a517-4693-bfc4-7defb46fdef2-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-7a2f5262-75f9-48c2-8625-4b22262699db-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-127a7e84-9f81-42b4-a126-82a5880df773-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-7a2f5262-75f9-48c2-8625-4b22262699db-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-127a7e84-9f81-42b4-a126-82a5880df773-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:25 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD" returned: 1 in 0.669s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-quobyte-7a2f5262-75f9-48c2-8625-4b22262699db" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] 3b45bfdc-551e-434e-828d-6faaa1a4cfac was raw, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:25 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.591s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:25 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:25 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-quobyte-127a7e84-9f81-42b4-a126-82a5880df773" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Deleted volume successfully.
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-7a2f5262-75f9-48c2-8625-4b22262699db" acquired by "delete_volume" :: waited 0.209s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-127a7e84-9f81-42b4-a126-82a5880df773" acquired by "delete_volume" :: waited 0.098s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[30637c62-4798-423a-b8dc-6311db68320f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314656e-6f38-483a-a37d-947dc9e2ae92]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c79fd7eb-a0e0-4f94-9d68-7da22e2ca437 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-a555e310-ad73-465a-a176-3ed95021ebd4-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:26 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773
Sep 12 21:13:26 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:26 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db
Sep 12 21:13:26 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:26 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 0 in 0.790s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b45bfdc-551e-434e-828d-6faaa1a4cfac_q27ouwr4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:13:26 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Converted 0.00 MB image at 0.00 MB/s
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:26 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 1G
Sep 12 21:13:26 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:26 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db" returned: 0 in 0.919s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:26 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db
Sep 12 21:13:26 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:26 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773" returned: 0 in 1.118s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:26 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773
Sep 12 21:13:26 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:27 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 1G" returned: 0 in 0.862s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:27 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[37688bc0-5e60-401d-a3f8-088aab32e70b]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-7a2f5262-75f9-48c2-8625-4b22262699db" returned: 0 in 0.548s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-7a2f5262-75f9-48c2-8625-4b22262699db" released by "delete_volume" :: held 1.655s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created reservations ['87a81a1d-f4b2-4ff8-86ef-2f1809654695', 'ca8fcd3f-f59e-4fad-94da-c0a33ffce1a8', '6541a3e4-5248-4f40-9c2d-8f6dac019820', '856c647b-fbd9-47cc-9636-8898fecfcadc'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:27 devstack sudo[107855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:27 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-127a7e84-9f81-42b4-a126-82a5880df773" returned: 0 in 0.672s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:27 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-127a7e84-9f81-42b4-a126-82a5880df773" released by "delete_volume" :: held 2.035s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:27 devstack sudo[107860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:27 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:27 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Created reservations ['31190b34-aecb-4271-8e45-3cb9e5624a41', '83475305-24bf-415b-8802-ee02c5537b5d', 'cfba9e28-b6ad-46fa-bf8c-b84770d1f310', '789a8c70-a7d9-44e6-8d30-6abd1a880455'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:28 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 0 in 0.937s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:28 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:28 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:28 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.408s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:28 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Deleted volume successfully.
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-40489a3e-c793-4a56-9a71-cfa77434e4e4 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-7a2f5262-75f9-48c2-8625-4b22262699db-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:28 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:28 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:28 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.573s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:28 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Deleted volume successfully.
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb83b35e-719c-4b9e-8ad9-34f2de9d9c09 tempest-CinderUnicodeTest-880865727 None] Lock "cinder-127a7e84-9f81-42b4-a126-82a5880df773-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-09b1d5f5-82fb-4555-b957-2fac95181667-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:28 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 1 in 0.835s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Downloaded image 3b45bfdc-551e-434e-828d-6faaa1a4cfac ((None, [{'url': 'file:///opt/stack/data/glance/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'metadata': {}}])) to volume cdcfaff0-6ea2-43b7-abf4-7311460c32a3 successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Temporary image 3b45bfdc-551e-434e-828d-6faaa1a4cfac for user c54b2ec95b6c43bfaf7594a8c8ebaf71 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Marking volume cdcfaff0-6ea2-43b7-abf4-7311460c32a3 as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Lock "cinder-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-09b1d5f5-82fb-4555-b957-2fac95181667-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Copying metadata from image 3b45bfdc-551e-434e-828d-6faaa1a4cfac to cdcfaff0-6ea2-43b7-abf4-7311460c32a3. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Creating volume glance metadata for volume cdcfaff0-6ea2-43b7-abf4-7311460c32a3 backed by image 3b45bfdc-551e-434e-828d-6faaa1a4cfac with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fce0f1c6c34dd06a9688b4df60a83e5f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Acquiring lock "cinder-quobyte-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-quobyte-09b1d5f5-82fb-4555-b957-2fac95181667" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12" acquired by "delete_volume" :: waited 0.052s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-09b1d5f5-82fb-4555-b957-2fac95181667" acquired by "delete_volume" :: waited 0.080s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fb5ff-ad1c-40b9-a996-dedbfc9894d8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b07607-bf4b-49de-bde0-3d02cb9b4b6f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbe2bd0-8b89-4e4c-85db-853d1609849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3', 'volume_size': 1, 'image_id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fce0f1c6c34dd06a9688b4df60a83e5f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '328a01f96a2d4b0eb1a5de16ad0e4d67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b214dda9932dbf111ff29dc8e33045779bcc2233e7253938a9acd0a7441564b8c49367df425c2b13e600525b160254a03894e72fa33253e621281a916f70396b', 'id': '3b45bfdc-551e-434e-828d-6faaa1a4cfac', 'created_at': datetime.datetime(2026, 9, 12, 19, 13, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 13, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b45bfdc-551e-434e-828d-6faaa1a4cfac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d5056ce8f50>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b6a70-14d8-45b8-99c0-8e8673961f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:29 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Volume volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 (cdcfaff0-6ea2-43b7-abf4-7311460c32a3): created successfully
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b6a70-14d8-45b8-99c0-8e8673961f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Flow 'volume_create_manager' (d6ad2ae0-4708-4c26-a83e-65798ac0417a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-02575210-8a20-4be9-95b9-68e236ca018d tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Created volume successfully.
Sep 12 21:13:29 devstack sudo[107871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12
Sep 12 21:13:29 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:29 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667
Sep 12 21:13:29 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:30 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667" returned: 0 in 0.788s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:30 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667
Sep 12 21:13:30 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:30 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12" returned: 0 in 1.121s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:30 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12
Sep 12 21:13:30 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:30 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-09b1d5f5-82fb-4555-b957-2fac95181667" returned: 0 in 0.422s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-09b1d5f5-82fb-4555-b957-2fac95181667" released by "delete_volume" :: held 1.337s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:30 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" returned: 0 in 6.129s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[96376909-21bd-4541-a41a-26f73c12565b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created reservations ['0afe1be6-1952-4fa7-b60e-6cdc674b6f47', '403407f3-27fb-4b35-b977-f4dbfc228481', 'd6ba308d-0e7d-490e-97b6-b16f1c58486a', '5f76f8a7-986c-4c67-8318-818c7b8185ef'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Acquiring lock "cinder-cdcfaff0-6ea2-43b7-abf4-7311460c32a3-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "cinder-cdcfaff0-6ea2-43b7-abf4-7311460c32a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:30 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:30 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:30 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:30 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:30 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Acquiring lock "cinder-quobyte-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Lock "cinder-quobyte-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12" released by "delete_volume" :: held 1.652s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "cinder-quobyte-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f562ff0-66b9-43e9-a2f1-2bef8f359ab8]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:30 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Created reservations ['39aefb4e-8919-46fc-b74b-68b51921e5f3', '10864832-b64a-45b1-9ed8-0006d32c2242', '0b2bf176-5b43-4637-9d8e-c263890aa902', 'b91416cb-b9d4-4f82-a0dd-c47556cbd537'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:31 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:31 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:31 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:31 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:31 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.316s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Deleted volume successfully.
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9088c821-7cf3-4bf6-b0da-65f44b757898 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-09b1d5f5-82fb-4555-b957-2fac95181667-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:31 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.295s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Deleted volume successfully.
Sep 12 21:13:31 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.695s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:13:31 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Converted 1024.00 MB image at 167.04 MB/s
Sep 12 21:13:31 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 is being set with open permissions: ugo+rw
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:31 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 0 in 0.467s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:31 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7
Sep 12 21:13:31 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-0d4db686-6d22-43f6-b56c-1d2f315fb1ae-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-0d4db686-6d22-43f6-b56c-1d2f315fb1ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-58d73f37-d3ba-46d9-a552-97ccdb09460b tempest-CinderUnicodeTest-880865727 None] Lock "cinder-a9fe3d4d-c6ad-4e35-9ee3-cea2ed4bec12-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "cinder-quobyte-0d4db686-6d22-43f6-b56c-1d2f315fb1ae" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-0d4db686-6d22-43f6-b56c-1d2f315fb1ae" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd82c636-bcb0-477f-8119-f13ef14eef57]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:31 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:31 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:31 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae
Sep 12 21:13:31 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:31 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" returned: 0 in 0.366s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" released by "_copy_volume_from_snapshot" :: held 8.457s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-6ca7de79-b01b-4380-8d40-dc31caf6357b-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" released by "_create_volume_from_snapshot" :: held 8.512s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.543s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e0123f-e08e-495c-834d-0772a7bc9952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7', 'volume_size': 1, 'snapshot_id': '6ca7de79-b01b-4380-8d40-dc31caf6357b'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7253c5-31bf-4afd-b97f-ac8f178b5096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:31 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Volume volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 (3410ec10-7aa4-425d-843e-3dfcd7ef3da7): created successfully
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7253c5-31bf-4afd-b97f-ac8f178b5096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:31 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Flow 'volume_create_manager' (963823fb-f453-4082-a9d6-e07136d50a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 1 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:31 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3
Sep 12 21:13:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e605cda7-5880-4f1c-8563-c4720175ca9d tempest-VolumeDependencyTests-658882148 None] Created volume successfully.
Sep 12 21:13:31 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:31 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae" returned: 0 in 0.447s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:32 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae
Sep 12 21:13:32 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:32 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" returned: 0 in 0.292s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "cinder-quobyte-cdcfaff0-6ea2-43b7-abf4-7311460c32a3" released by "delete_volume" :: held 1.279s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Created reservations ['5348b2f8-2bc7-4a1f-b706-2e18c94aef05', '87d34161-56f6-41d6-a534-5ca62ce4da03', 'e4f24ca4-aa7b-4fc7-8c01-80b7d63fa6dc', 'd53e5ed1-dd4d-495d-b022-b4b503c55513'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:32 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0d4db686-6d22-43f6-b56c-1d2f315fb1ae" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-quobyte-0d4db686-6d22-43f6-b56c-1d2f315fb1ae" released by "delete_volume" :: held 0.801s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:32 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:32 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Created reservations ['c7a54a93-e284-4ecd-a5ce-465331dffc6c', '97cd8324-f557-485c-934b-7c1cdbf87f80', '3999e250-2d9b-427c-a79f-7b54c9343108', '94e0ae05-c4bd-4a94-a324-d82e2aa05cb4'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-6ca7de79-b01b-4380-8d40-dc31caf6357b-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:32 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:32 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-6ca7de79-b01b-4380-8d40-dc31caf6357b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-quobyte-159057dd-675d-41e1-80f1-bc27250bbb4b" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-159057dd-675d-41e1-80f1-bc27250bbb4b" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-quobyte-6ca7de79-b01b-4380-8d40-dc31caf6357b" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-6ca7de79-b01b-4380-8d40-dc31caf6357b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Deleting offline snapshot 6ca7de79-b01b-4380-8d40-dc31caf6357b of volume 159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:13:32 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] snapshot_file for this snap is: volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.436s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Deleted volume successfully.
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc55c4-e647-4186-bedd-171be3ae2ccb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7bb66af9-694a-4e7a-9931-bff5dbc76991 tempest-VolumeAndVolumeTypeFromImageTest-1622132520 None] Lock "cinder-cdcfaff0-6ea2-43b7-abf4-7311460c32a3-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:32 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.300s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Deleted volume successfully.
Sep 12 21:13:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-eb66b438-22ac-4297-986d-c64f63a46262 tempest-CreateVolumesFromSourceVolumeTest-1241991729 None] Lock "cinder-0d4db686-6d22-43f6-b56c-1d2f315fb1ae-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:32 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b
Sep 12 21:13:32 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:33 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b" returned: 0 in 0.446s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159057dd-675d-41e1-80f1-bc27250bbb4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b529b1af-672d-4466-9082-743a818897a6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:33 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:33 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:33 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:33 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:33 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.423s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:33 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b
Sep 12 21:13:33 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:33 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.470s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:34 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:34 devstack sudo[107949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b
Sep 12 21:13:34 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:34 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b.6ca7de79-b01b-4380-8d40-dc31caf6357b" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-6ca7de79-b01b-4380-8d40-dc31caf6357b" released by "_delete_snapshot" :: held 1.853s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-159057dd-675d-41e1-80f1-bc27250bbb4b" released by "delete_snapshot" :: held 1.901s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Created reservations ['daa66b6c-d6ec-4bae-8c6b-c4c212c11044', '286fb47f-12a0-4ccc-8676-1c2bab4e17c1', '260e6a61-df42-491b-86d5-bfb77ff19316', 'b46842b1-5a56-4937-b0d1-735b9db6ac5c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Delete snapshot completed successfully.
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e644c075-23e0-484e-86c8-835382f0921d tempest-VolumeDependencyTests-658882148 None] Lock "cinder-6ca7de79-b01b-4380-8d40-dc31caf6357b-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-159057dd-675d-41e1-80f1-bc27250bbb4b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Lock "cinder-159057dd-675d-41e1-80f1-bc27250bbb4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-quobyte-159057dd-675d-41e1-80f1-bc27250bbb4b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-159057dd-675d-41e1-80f1-bc27250bbb4b" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9920bf80-d4c8-4463-8fdf-a546df99452f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:35 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:35 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:35 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.494s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:35 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b
Sep 12 21:13:35 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:35 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-159057dd-675d-41e1-80f1-bc27250bbb4b" returned: 0 in 0.293s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-159057dd-675d-41e1-80f1-bc27250bbb4b" released by "delete_volume" :: held 0.878s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:35 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Created reservations ['4e8b8641-78b8-4580-8942-e28e8125c689', 'db6a61c7-0cb9-4821-92f0-616d5ff0cd58', 'a9314869-bec7-4ef1-857c-a20315dfc567', 'b978ddd7-d405-439c-957b-3505463e0899'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:36 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:36 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-3410ec10-7aa4-425d-843e-3dfcd7ef3da7-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Lock "cinder-3410ec10-7aa4-425d-843e-3dfcd7ef3da7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Acquiring lock "cinder-quobyte-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080462b-32bf-4058-81fb-00cdbca6f29d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:36 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.346s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Deleted volume successfully.
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-17e699f0-4987-4227-9488-dfe11e43df8b tempest-VolumeDependencyTests-658882148 None] Lock "cinder-159057dd-675d-41e1-80f1-bc27250bbb4b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:36 devstack sudo[107963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7
Sep 12 21:13:36 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:36 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" returned: 0 in 0.465s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:36 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7
Sep 12 21:13:36 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:37 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" returned: 0 in 0.286s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Lock "cinder-quobyte-3410ec10-7aa4-425d-843e-3dfcd7ef3da7" released by "delete_volume" :: held 0.826s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Created reservations ['46fcb182-42f7-448a-85e2-4174d8a84b22', '1c6d0694-dca0-4d66-8ddc-ca0823043560', '8363189a-4a9f-4fbd-a7d8-251d6d6705de', 'a833cfef-2beb-4e47-aa65-710403dbcaab'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:37 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:37 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (83907552-e7b8-4aba-9faa-ecc45a6b7501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d633ed6-3085-4515-8e86-94a06902dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d633ed6-3085-4515-8e86-94a06902dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-293386173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd15381-f540-42f8-9f8c-7310c52a905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:37Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5b6fcc-998c-489d-9c21-3264905ff0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5b6fcc-998c-489d-9c21-3264905ff0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31afc203-dd6d-4350-b01f-479007f3a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31afc203-dd6d-4350-b01f-479007f3a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd15381-f540-42f8-9f8c-7310c52a905e', 'volume_name': 'volume-dcd15381-f540-42f8-9f8c-7310c52a905e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c0170e-420e-4914-932b-fab5bba5626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c0170e-420e-4914-932b-fab5bba5626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28801eed-4e2d-4340-8223-88f5dea4e43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:37 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Volume dcd15381-f540-42f8-9f8c-7310c52a905e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd15381-f540-42f8-9f8c-7310c52a905e', 'volume_size': 1}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-293386173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd15381-f540-42f8-9f8c-7310c52a905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:37Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Creating volume dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:37 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:37 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e 1073741824
Sep 12 21:13:37 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:37 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.523s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Deleted volume successfully.
Sep 12 21:13:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-879b9cdd-ca83-4c6d-87bd-c816b6a61d90 tempest-VolumeDependencyTests-658882148 None] Lock "cinder-3410ec10-7aa4-425d-843e-3dfcd7ef3da7-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:38 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e 1073741824" returned: 0 in 0.573s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:38 devstack sudo[107981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e
Sep 12 21:13:38 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:38 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e" returned: 0 in 0.310s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28801eed-4e2d-4340-8223-88f5dea4e43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd15381-f540-42f8-9f8c-7310c52a905e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88dc7ff-93b9-4cd6-8922-e8245c7d6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:38 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Volume volume-dcd15381-f540-42f8-9f8c-7310c52a905e (dcd15381-f540-42f8-9f8c-7310c52a905e): created successfully
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88dc7ff-93b9-4cd6-8922-e8245c7d6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:38 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (83907552-e7b8-4aba-9faa-ecc45a6b7501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:38 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-aac40263-b374-4c8b-97e4-fd7474031702 tempest-ProjectReaderTests-2004611754 None] Created volume successfully.
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (858d8d88-1a61-410c-a871-afa22eaac215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c2ff68-a5e2-4e1e-a6ce-709a7a7d65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c2ff68-a5e2-4e1e-a6ce-709a7a7d65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2050250213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9b7bdd-5761-4a37-9c07-773883646b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:39Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311d7609-dee7-43ed-bb16-6a327c3dd0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311d7609-dee7-43ed-bb16-6a327c3dd0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56979f5-24ce-42c0-af79-f3b543b8a836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64 1073741824
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56979f5-24ce-42c0-af79-f3b543b8a836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9b7bdd-5761-4a37-9c07-773883646b64', 'volume_name': 'volume-6d9b7bdd-5761-4a37-9c07-773883646b64', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3487685-3133-4097-9d1b-9ba25ebba7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3487685-3133-4097-9d1b-9ba25ebba7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b35586-2629-4ed0-a9e2-ddb8b4371696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume 6d9b7bdd-5761-4a37-9c07-773883646b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9b7bdd-5761-4a37-9c07-773883646b64', 'volume_size': 1}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2050250213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9b7bdd-5761-4a37-9c07-773883646b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:39Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Creating volume 6d9b7bdd-5761-4a37-9c07-773883646b64 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:39 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:39 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (43983918-8002-43be-81fd-3dd8e4983ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d19a92-dfc7-4047-aa87-e5c49fc1abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d19a92-dfc7-4047-aa87-e5c49fc1abcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277153884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:40Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3778420d-8916-464b-b7a6-8506eb3d0e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:39 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3778420d-8916-464b-b7a6-8506eb3d0e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed2e2a6-a04e-4abe-ae90-09efd5d154e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed2e2a6-a04e-4abe-ae90-09efd5d154e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4', 'volume_name': 'volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd74ff9-85ff-4e68-8042-5d2dcea4ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd74ff9-85ff-4e68-8042-5d2dcea4ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e09893-8c86-46c0-a8fe-d6536fea46c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Volume 952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4', 'volume_size': 1}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:40 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64 1073741824" returned: 0 in 0.716s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:40 devstack sudo[107991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64
Sep 12 21:13:40 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:40 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64" returned: 0 in 0.327s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277153884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:40Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Creating volume 952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:40 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b35586-2629-4ed0-a9e2-ddb8b4371696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9b7bdd-5761-4a37-9c07-773883646b64', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 1073741824
Sep 12 21:13:40 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcd2877-c981-4efe-968f-de610fe28cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume volume-6d9b7bdd-5761-4a37-9c07-773883646b64 (6d9b7bdd-5761-4a37-9c07-773883646b64): created successfully
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcd2877-c981-4efe-968f-de610fe28cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (858d8d88-1a61-410c-a871-afa22eaac215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (fa2395b1-5faa-4be7-a1c7-e946f3c612d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055ea346-413a-4ac7-8fa1-88b979ffa2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-12f8f66f-d82d-41bc-9f42-85eae1cd4df0 tempest-CreateVolumesFromImageTest-1548024110 None] Created volume successfully.
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055ea346-413a-4ac7-8fa1-88b979ffa2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1073306980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec598bcb-31b8-4303-b9c7-0c371a88c7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:41Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f935bc40-f1cf-4da8-887d-8756310858e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f935bc40-f1cf-4da8-887d-8756310858e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff05becd-95f0-4341-b0ec-76523928ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff05becd-95f0-4341-b0ec-76523928ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec598bcb-31b8-4303-b9c7-0c371a88c7f7', 'volume_name': 'volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe98f741-50c8-412d-a7c3-b4682efeed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe98f741-50c8-412d-a7c3-b4682efeed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8c4339-c6f5-4f23-8853-cc52b90c6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:40 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume ec598bcb-31b8-4303-b9c7-0c371a88c7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7', 'volume_size': 1}
Sep 12 21:13:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:41 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 1073741824" returned: 0 in 0.774s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:41 devstack sudo[108000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4
Sep 12 21:13:41 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (2186f250-ee8b-4852-8b1e-5fbd8bec248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca21a741-91fe-4348-90ef-dc08db582542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca21a741-91fe-4348-90ef-dc08db582542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753294042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f0912a-ed2e-49e9-ad88-1c63dd7b179f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:41Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6fcdce-1106-4c0f-9838-b899ecd446ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6fcdce-1106-4c0f-9838-b899ecd446ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f2fcb7-ae8d-4745-9a46-a074302625bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f2fcb7-ae8d-4745-9a46-a074302625bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f0912a-ed2e-49e9-ad88-1c63dd7b179f', 'volume_name': 'volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37d3029-5866-4836-b475-d3135df28d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37d3029-5866-4836-b475-d3135df28d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc3e6c-77eb-4629-b69b-0d7a0313a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Volume 69f0912a-ed2e-49e9-ad88-1c63dd7b179f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f', 'volume_size': 1}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (d7363ef8-6cda-4883-9120-b3c033926ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd1edf4-e59b-4c49-ba5c-4f4bfa0d4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd1edf4-e59b-4c49-ba5c-4f4bfa0d4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-986211152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9e0a4f-49ac-4e35-8d76-382f549ac043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:42Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1da24d1-8e07-4abf-9f68-cf2cc5ae945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1da24d1-8e07-4abf-9f68-cf2cc5ae945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e352b40-9e87-4e87-8ea4-d473d07f9b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e352b40-9e87-4e87-8ea4-d473d07f9b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9e0a4f-49ac-4e35-8d76-382f549ac043', 'volume_name': 'volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44624252-6aae-4b81-ae61-1a023dc8cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44624252-6aae-4b81-ae61-1a023dc8cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee52dd80-bdfe-4e59-9a79-031fdb690902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume 2d9e0a4f-49ac-4e35-8d76-382f549ac043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043', 'volume_size': 1}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:41 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4" returned: 0 in 0.304s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.517s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Creating offline snapshot da96866f-42a1-40ec-b1d8-7bbb314d12f2 of volume dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e09893-8c86-46c0-a8fe-d6536fea46c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3903c2-8597-47d9-97f9-66f8c85977d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c7320-c63b-48c3-837c-5105eb1dd9b4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:41 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Volume volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 (952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4): created successfully
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3903c2-8597-47d9-97f9-66f8c85977d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:41 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (43983918-8002-43be-81fd-3dd8e4983ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:41 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-fcbfea60-912f-4191-8fa4-045231b823af tempest-CreateVolumesFromImageTest-1548024110 None] Created volume successfully.
Sep 12 21:13:41 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e
Sep 12 21:13:41 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:42 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e" returned: 0 in 0.431s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:42 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 1G
Sep 12 21:13:42 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:42 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 1G" returned: 0 in 0.472s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd15381-f540-42f8-9f8c-7310c52a905e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:42 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd15381-f540-42f8-9f8c-7310c52a905e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2
Sep 12 21:13:42 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:43 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd15381-f540-42f8-9f8c-7310c52a905e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2" returned: 0 in 0.321s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:43 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 is being set with open permissions: ugo+rw
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:43 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2
Sep 12 21:13:43 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:43 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2" returned: 0 in 0.305s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:43 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info
Sep 12 21:13:43 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:43 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info" returned: 0 in 0.312s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:43 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info is being set with open permissions: ugo+rw
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:43 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info
Sep 12 21:13:43 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:43 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.info" returned: 0 in 0.270s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.131s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1073306980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec598bcb-31b8-4303-b9c7-0c371a88c7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:41Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Creating volume ec598bcb-31b8-4303-b9c7-0c371a88c7f7 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:44 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:44 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 1073741824
Sep 12 21:13:44 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0b8ddb8e-a624-4065-8a13-56828923d343 tempest-ProjectReaderTests-2004611754 None] Create snapshot completed successfully
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Flow 'volume_create_manager' (85841910-fc90-4447-a23d-ed2956a6641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079f7fb6-e690-4f1a-be6a-ba09661df531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079f7fb6-e690-4f1a-be6a-ba09661df531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856e14e1-43aa-46c4-8bcb-7d48119efeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077f97b2bf8431caf4e727d1ad62d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:44Z,use_quota=True,user_id='d810479562d44d53b3a1b35588ca3a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5c4e5d-8b2f-46ab-9114-53fdf44e1cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5c4e5d-8b2f-46ab-9114-53fdf44e1cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d0aacc-9b37-4a44-9f4d-82c1643527e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.image.glance [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Creating Keystone auth plugin from conf {{(pid=87624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 12 21:13:44 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 1073741824" returned: 0 in 0.539s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:44 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7
Sep 12 21:13:44 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d0aacc-9b37-4a44-9f4d-82c1643527e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '856e14e1-43aa-46c4-8bcb-7d48119efeed', 'volume_name': 'volume-856e14e1-43aa-46c4-8bcb-7d48119efeed', 'volume_size': 1, 'image_id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c014e6-bd29-4228-a572-f400bc3bd81a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06d9d448b080191e3a69f3002877fdb0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7077f97b2bf8431caf4e727d1ad62d5b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ab297933734d10df981c4a63832a42debd63b3e56881a456a48c026480d5bf37cb239857df9f1cda97415bf254da453d1da5e2593337698e7ee257eb3b89195', 'id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'created_at': datetime.datetime(2026, 9, 12, 19, 13, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 13, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c014e6-bd29-4228-a572-f400bc3bd81a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d504ca33c20>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efad9a2-1da5-4579-9c6f-320f24369966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efad9a2-1da5-4579-9c6f-320f24369966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe5e31e-993d-4c2b-addb-76349b4faee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:44 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Volume 856e14e1-43aa-46c4-8bcb-7d48119efeed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-856e14e1-43aa-46c4-8bcb-7d48119efeed', 'volume_size': 1, 'image_id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c014e6-bd29-4228-a572-f400bc3bd81a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06d9d448b080191e3a69f3002877fdb0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7077f97b2bf8431caf4e727d1ad62d5b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ab297933734d10df981c4a63832a42debd63b3e56881a456a48c026480d5bf37cb239857df9f1cda97415bf254da453d1da5e2593337698e7ee257eb3b89195', 'id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'created_at': datetime.datetime(2026, 9, 12, 19, 13, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 13, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c014e6-bd29-4228-a572-f400bc3bd81a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d504ca33c20>}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Trying to clone 856e14e1-43aa-46c4-8bcb-7d48119efeed from image b2c014e6-bd29-4228-a572-f400bc3bd81a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2c014e6-bd29-4228-a572-f400bc3bd81a', 'metadata': {}}]). {{(pid=87624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-da96866f-42a1-40ec-b1d8-7bbb314d12f2-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-da96866f-42a1-40ec-b1d8-7bbb314d12f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-dcd15381-f540-42f8-9f8c-7310c52a905e" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:44 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7" returned: 0 in 0.345s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.348s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753294042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f0912a-ed2e-49e9-ad88-1c63dd7b179f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:41Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Creating volume 69f0912a-ed2e-49e9-ad88-1c63dd7b179f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:44 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack sudo[108039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f 1073741824
Sep 12 21:13:45 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8c4339-c6f5-4f23-8853-cc52b90c6de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b2b0b9-e917-4dd5-9c12-6605aa345eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-dcd15381-f540-42f8-9f8c-7310c52a905e" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-da96866f-42a1-40ec-b1d8-7bbb314d12f2" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:45 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 (ec598bcb-31b8-4303-b9c7-0c371a88c7f7): created successfully
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b2b0b9-e917-4dd5-9c12-6605aa345eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (fa2395b1-5faa-4be7-a1c7-e946f3c612d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-da96866f-42a1-40ec-b1d8-7bbb314d12f2" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Deleting offline snapshot da96866f-42a1-40ec-b1d8-7bbb314d12f2 of volume dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] snapshot_file for this snap is: volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Sep 12 21:13:45 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Image download 0.00 MB at 0.00 MB/s
Sep 12 21:13:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9c89ca07-2d28-43a2-8664-f21c37af52c0 tempest-CreateVolumesFromImageTest-1548024110 None] Created volume successfully.
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[132a906f-7636-48f9-b0dc-7e96162a739a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf032448-3ac5-4094-bde7-1c6b3305ae17]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2
Sep 12 21:13:45 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD
Sep 12 21:13:45 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f 1073741824" returned: 0 in 0.491s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f
Sep 12 21:13:45 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2" returned: 0 in 0.443s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd15381-f540-42f8-9f8c-7310c52a905e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7d4753-e78d-4a95-86ae-69f669ce4d6a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e
Sep 12 21:13:45 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:45 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD
Sep 12 21:13:45 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f" returned: 0 in 0.298s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.070s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-986211152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9e0a4f-49ac-4e35-8d76-382f549ac043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c678de3358d4e32804e0a7dddf2e128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:42Z,use_quota=True,user_id='141b733856c14835b6e3b460ce3edabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Creating volume 2d9e0a4f-49ac-4e35-8d76-382f549ac043 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:45 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc3e6c-77eb-4629-b69b-0d7a0313a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9eef8c-180a-43e2-a14c-ae84214b723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:45 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 1073741824
Sep 12 21:13:45 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:45 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Volume volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f (69f0912a-ed2e-49e9-ad88-1c63dd7b179f): created successfully
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9eef8c-180a-43e2-a14c-ae84214b723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (2186f250-ee8b-4852-8b1e-5fbd8bec248a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-75a48303-fcac-4932-a088-3de8b0799660 tempest-CreateVolumesFromImageTest-1548024110 None] Created volume successfully.
Sep 12 21:13:46 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e" returned: 0 in 0.492s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:46 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2
Sep 12 21:13:46 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:46 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD" returned: 1 in 0.490s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Temporary image b2c014e6-bd29-4228-a572-f400bc3bd81a is fetched for user d810479562d44d53b3a1b35588ca3a91. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cfd184-3bcc-4937-ae69-c0a23ea31243]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:46 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD
Sep 12 21:13:46 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:46 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 1073741824" returned: 0 in 0.621s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:46 devstack sudo[108085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043
Sep 12 21:13:46 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:46 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2" returned: 0 in 0.448s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:46 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2
Sep 12 21:13:46 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:46 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:46 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee52dd80-bdfe-4e59-9a79-031fdb690902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cde16c-feaf-4a64-9d10-8d764da89211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:46 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD
Sep 12 21:13:46 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:46 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Volume volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 (2d9e0a4f-49ac-4e35-8d76-382f549ac043): created successfully
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cde16c-feaf-4a64-9d10-8d764da89211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Flow 'volume_create_manager' (d7363ef8-6cda-4883-9120-b3c033926ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:46 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-166d1803-173b-4739-aeea-17311e74f8a0 tempest-CreateVolumesFromImageTest-1548024110 None] Created volume successfully.
Sep 12 21:13:46 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e.da96866f-42a1-40ec-b1d8-7bbb314d12f2" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-da96866f-42a1-40ec-b1d8-7bbb314d12f2" released by "_delete_snapshot" :: held 1.839s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-dcd15381-f540-42f8-9f8c-7310c52a905e" released by "delete_snapshot" :: held 1.888s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:46 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Created reservations ['04630c5a-0321-4bc6-bc11-069f98dcf0c0', 'c666b37e-726d-4b4e-b58b-b4dbaf0db522', 'e0c7a3ef-52f1-4249-b692-1c3ce73cf354', 'cabac45e-4e30-4d9f-b358-9f0ed7a7e3ff'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:47 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856e14e1-43aa-46c4-8bcb-7d48119efeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077f97b2bf8431caf4e727d1ad62d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:44Z,use_quota=True,user_id='d810479562d44d53b3a1b35588ca3a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Creating volume 856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:47 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Delete snapshot completed successfully.
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-614901c1-370a-4e76-8ef3-5d0fbd774b7e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-da96866f-42a1-40ec-b1d8-7bbb314d12f2-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:47 devstack sudo[108098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed 1073741824
Sep 12 21:13:47 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-dcd15381-f540-42f8-9f8c-7310c52a905e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-dcd15381-f540-42f8-9f8c-7310c52a905e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-2d9e0a4f-49ac-4e35-8d76-382f549ac043-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-2d9e0a4f-49ac-4e35-8d76-382f549ac043-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-dcd15381-f540-42f8-9f8c-7310c52a905e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-dcd15381-f540-42f8-9f8c-7310c52a905e" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-quobyte-2d9e0a4f-49ac-4e35-8d76-382f549ac043" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf6f69-1563-4297-badd-2be479046238]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-2d9e0a4f-49ac-4e35-8d76-382f549ac043" acquired by "delete_volume" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c3606-2465-4605-8f8f-448ecce8f642]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:47 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e
Sep 12 21:13:47 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:47 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed 1073741824" returned: 0 in 0.470s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:47 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043
Sep 12 21:13:47 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:47 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:47 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:47 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:47 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 0 in 0.259s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:47 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e
Sep 12 21:13:47 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:47 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043" returned: 0 in 0.436s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Attempting download of b2c014e6-bd29-4228-a572-f400bc3bd81a ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c014e6-bd29-4228-a572-f400bc3bd81a', 'metadata': {}}])) to volume 856e14e1-43aa-46c4-8bcb-7d48119efeed. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 12 21:13:47 devstack sudo[108119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043
Sep 12 21:13:47 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e3efb-3327-4f87-8ce1-39ca68e62a68]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:48 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2
Sep 12 21:13:48 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:48 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-dcd15381-f540-42f8-9f8c-7310c52a905e" returned: 0 in 0.301s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-dcd15381-f540-42f8-9f8c-7310c52a905e" released by "delete_volume" :: held 0.814s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:48 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-2d9e0a4f-49ac-4e35-8d76-382f549ac043" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-2d9e0a4f-49ac-4e35-8d76-382f549ac043" released by "delete_volume" :: held 0.799s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Created reservations ['548fce88-4c97-4a5b-ab9d-0d1e4ea7aef2', '91999984-74b3-409a-8453-fbcfa4149cd0', '9639e4bc-9f34-4050-8b38-d9941cd16862', '49b84738-a2a7-42ca-8ead-67c36a723d06'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Created reservations ['aafa8039-be59-4b87-af42-585141dcc884', 'e8568531-058a-421e-aab5-4d5d08673ea1', '505e7c74-ff4d-4b9b-a9c5-bb1abfc717e3', 'cdb12495-aacf-4739-a91f-77dbfaacf220'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:48 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2" returned: 0 in 0.400s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:48 devstack sudo[108128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:48 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:48 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:48 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:48 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2
Sep 12 21:13:48 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:48 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.374s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:48 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Deleted volume successfully.
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2" returned: 1 in 0.453s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c014e6-bd29-4228-a572-f400bc3bd81a_p14svw_2' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e9f5ae-9ac0-4a68-a2bc-752dc4b9b7e2]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-fb59299f-5f67-4745-ad23-e5eaf446be5e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-dcd15381-f540-42f8-9f8c-7310c52a905e-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:48 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.433s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-69f0912a-ed2e-49e9-ad88-1c63dd7b179f-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Deleted volume successfully.
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-69f0912a-ed2e-49e9-ad88-1c63dd7b179f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-d5feaac5-55ec-482b-91b9-c97947ff9f70 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-2d9e0a4f-49ac-4e35-8d76-382f549ac043-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:48 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-quobyte-69f0912a-ed2e-49e9-ad88-1c63dd7b179f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-69f0912a-ed2e-49e9-ad88-1c63dd7b179f" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:49 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD
Sep 12 21:13:49 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d686a-f073-4202-86fc-b5055a95d2a6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:49 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f
Sep 12 21:13:49 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:49 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD
Sep 12 21:13:49 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (5059f92e-f8d1-4941-8107-e5c21756d613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220d2e3f-471d-4c38-850d-f484a23cbd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:49 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220d2e3f-471d-4c38-850d-f484a23cbd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258085104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969c2597-d2d4-496b-916f-ddd2329bc7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:49Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e312fe3b-361c-4c3b-bff0-dc868ce241a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e312fe3b-361c-4c3b-bff0-dc868ce241a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cf96e2-0801-4375-b87e-803419216658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cf96e2-0801-4375-b87e-803419216658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969c2597-d2d4-496b-916f-ddd2329bc7e4', 'volume_name': 'volume-969c2597-d2d4-496b-916f-ddd2329bc7e4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6987f401-ab9d-43bb-8926-549201b30739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6987f401-ab9d-43bb-8926-549201b30739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35af77c-9e69-4912-9de2-bea46b24c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:49 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Volume 969c2597-d2d4-496b-916f-ddd2329bc7e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969c2597-d2d4-496b-916f-ddd2329bc7e4', 'volume_size': 1}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258085104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969c2597-d2d4-496b-916f-ddd2329bc7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:49Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Creating volume 969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:49 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f" returned: 0 in 0.472s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:49 devstack sudo[108149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 1073741824
Sep 12 21:13:49 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f
Sep 12 21:13:49 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] b2c014e6-bd29-4228-a572-f400bc3bd81a was raw, converting to raw {{(pid=87624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:49 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:49 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-69f0912a-ed2e-49e9-ad88-1c63dd7b179f" returned: 0 in 0.266s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-69f0912a-ed2e-49e9-ad88-1c63dd7b179f" released by "delete_volume" :: held 0.786s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Created reservations ['04a1ee48-281b-4790-b868-66bfc87e2b08', '6eab3b40-ebc1-4214-8939-ba90c182caf3', '418f4c5d-8dc1-4ac3-b94e-4b562c074cc1', '2c067532-55f4-4cc6-b95f-06d387362284'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:49 devstack sudo[108166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:49 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:49 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 1073741824" returned: 0 in 0.479s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:49 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 0 in 0.375s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2c014e6-bd29-4228-a572-f400bc3bd81a_ug4dbnccdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:13:49 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Converted 0.00 MB image at 0.00 MB/s
Sep 12 21:13:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:50 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed 1G
Sep 12 21:13:50 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:50 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4
Sep 12 21:13:50 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-ec598bcb-31b8-4303-b9c7-0c371a88c7f7-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-ec598bcb-31b8-4303-b9c7-0c371a88c7f7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:50 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.380s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-quobyte-ec598bcb-31b8-4303-b9c7-0c371a88c7f7" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Deleted volume successfully.
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-ec598bcb-31b8-4303-b9c7-0c371a88c7f7" acquired by "delete_volume" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-34c27f4b-36f0-4e16-9e22-3a4fbd89df8d tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-69f0912a-ed2e-49e9-ad88-1c63dd7b179f-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca93dd6-d4bb-4c5d-af80-92e8a0d0f6d4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:50 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4" returned: 0 in 0.394s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:50 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35af77c-9e69-4912-9de2-bea46b24c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969c2597-d2d4-496b-916f-ddd2329bc7e4', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14558875-6afd-4919-9bb8-2a544a11a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed 1G" returned: 0 in 0.479s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:50 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Volume volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 (969c2597-d2d4-496b-916f-ddd2329bc7e4): created successfully
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14558875-6afd-4919-9bb8-2a544a11a63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (5059f92e-f8d1-4941-8107-e5c21756d613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:50 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d8bb855d-611f-4f92-998e-da160e758b9b tempest-ProjectReaderTests-2004611754 None] Created volume successfully.
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9bbba-4be0-4288-a663-18781658a6d2]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:50 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7
Sep 12 21:13:50 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:50 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:50 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:50 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7" returned: 0 in 0.426s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:50 devstack sudo[108184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7
Sep 12 21:13:50 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:50 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 0 in 0.382s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:51 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:51 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:51 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ec598bcb-31b8-4303-b9c7-0c371a88c7f7" returned: 0 in 0.278s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-ec598bcb-31b8-4303-b9c7-0c371a88c7f7" released by "delete_volume" :: held 0.777s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Created reservations ['e1cb696b-1ced-4f14-bebd-9da12896d2a1', '3b66bab9-2dc4-4f60-8136-46625d36e7ef', '6c3a7bac-42ce-41f8-bb9e-42fb10aa1ff8', 'cd061c18-8424-4673-9596-6e0e07cbd779'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:51 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:51 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:51 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 1 in 0.515s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Downloaded image b2c014e6-bd29-4228-a572-f400bc3bd81a ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c014e6-bd29-4228-a572-f400bc3bd81a', 'metadata': {}}])) to volume 856e14e1-43aa-46c4-8bcb-7d48119efeed successfully. {{(pid=87624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Temporary image b2c014e6-bd29-4228-a572-f400bc3bd81a for user d810479562d44d53b3a1b35588ca3a91 is deleted. {{(pid=87624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.volume_utils [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Marking volume 856e14e1-43aa-46c4-8bcb-7d48119efeed as bootable. {{(pid=87624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Copying metadata from image b2c014e6-bd29-4228-a572-f400bc3bd81a to 856e14e1-43aa-46c4-8bcb-7d48119efeed. {{(pid=87624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Creating volume glance metadata for volume 856e14e1-43aa-46c4-8bcb-7d48119efeed backed by image b2c014e6-bd29-4228-a572-f400bc3bd81a with: {'image_id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '06d9d448b080191e3a69f3002877fdb0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:51 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-quobyte-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe5e31e-993d-4c2b-addb-76349b4faee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856e14e1-43aa-46c4-8bcb-7d48119efeed', 'volume_size': 1, 'image_id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c014e6-bd29-4228-a572-f400bc3bd81a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06d9d448b080191e3a69f3002877fdb0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7077f97b2bf8431caf4e727d1ad62d5b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ab297933734d10df981c4a63832a42debd63b3e56881a456a48c026480d5bf37cb239857df9f1cda97415bf254da453d1da5e2593337698e7ee257eb3b89195', 'id': 'b2c014e6-bd29-4228-a572-f400bc3bd81a', 'created_at': datetime.datetime(2026, 9, 12, 19, 13, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 12, 19, 13, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c014e6-bd29-4228-a572-f400bc3bd81a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d504ca33c20>}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f9fe39-afca-4350-9efe-1a8a7a0639fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Deleted volume successfully.
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:51 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Volume volume-856e14e1-43aa-46c4-8bcb-7d48119efeed (856e14e1-43aa-46c4-8bcb-7d48119efeed): created successfully
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f9fe39-afca-4350-9efe-1a8a7a0639fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Flow 'volume_create_manager' (85841910-fc90-4447-a23d-ed2956a6641e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c7ae68-0e6e-4a2b-94cf-f458f8b974fb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Creating offline snapshot e0047a49-0380-48c5-bf9f-24489a15752c of volume 969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:13:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-27ec138d-3b5c-4bc4-b8bc-d747d945d4cd tempest-VolumeImageDependencyTests-960347873 None] Created volume successfully.
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7ccf696b-98ca-45d6-b80d-584d0054c580 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-ec598bcb-31b8-4303-b9c7-0c371a88c7f7-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb5a534-be06-416e-891d-5e59b1cae74d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:51 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4
Sep 12 21:13:51 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:51 devstack sudo[108200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4
Sep 12 21:13:51 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:52 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4" returned: 0 in 0.392s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:52 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4
Sep 12 21:13:52 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:52 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4" returned: 0 in 0.403s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:52 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c 1G
Sep 12 21:13:52 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Acquiring lock "cinder-856e14e1-43aa-46c4-8bcb-7d48119efeed-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Lock "cinder-856e14e1-43aa-46c4-8bcb-7d48119efeed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:52 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4" returned: 0 in 0.328s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4" released by "delete_volume" :: held 0.803s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Acquiring lock "cinder-quobyte-856e14e1-43aa-46c4-8bcb-7d48119efeed" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Lock "cinder-quobyte-856e14e1-43aa-46c4-8bcb-7d48119efeed" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef982b0-2dd9-4c66-b10d-b719cd8ce5dc]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Created reservations ['5e581c13-6318-47de-abd1-9c56c8f4c3ee', 'df4cde33-3400-443f-b7bb-07d06bac21fb', 'c714fe1f-67f0-49a7-b10b-103bac20667b', '21a56078-8acc-4255-b0b1-5d5a4f6b944c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:52 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:52 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-6d9b7bdd-5761-4a37-9c07-773883646b64-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:52 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:52 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:52 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c 1G" returned: 0 in 0.612s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-6d9b7bdd-5761-4a37-9c07-773883646b64-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:52 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c
Sep 12 21:13:52 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "cinder-quobyte-6d9b7bdd-5761-4a37-9c07-773883646b64" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-6d9b7bdd-5761-4a37-9c07-773883646b64" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f1d7e6-bc76-4d0e-9548-0842facedc04]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:53 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Deleted volume successfully.
Sep 12 21:13:53 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cfe394d3-f1d9-4e93-ae31-542d6cf8271e tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-952e77fb-a59a-4ce1-b9e9-9b47ffb4e2c4-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 0 in 0.523s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:53 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64
Sep 12 21:13:53 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:53 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c" returned: 0 in 0.429s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c is being set with open permissions: ugo+rw
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:53 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:53 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:53 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c
Sep 12 21:13:53 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:53 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64" returned: 0 in 0.461s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:53 devstack sudo[108243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64
Sep 12 21:13:53 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:53 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c" returned: 0 in 0.336s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 1 in 0.471s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed' failed. Not Retrying. {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:53 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed
Sep 12 21:13:53 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:53 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info
Sep 12 21:13:53 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:53 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-6d9b7bdd-5761-4a37-9c07-773883646b64" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-quobyte-6d9b7bdd-5761-4a37-9c07-773883646b64" released by "delete_volume" :: held 0.904s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:53 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-856e14e1-43aa-46c4-8bcb-7d48119efeed" returned: 0 in 0.310s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Lock "cinder-quobyte-856e14e1-43aa-46c4-8bcb-7d48119efeed" released by "delete_volume" :: held 1.389s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Created reservations ['64d6eecc-7a11-43ed-85aa-f252953f3b67', 'ca56968d-7848-4aa1-a92e-320b48564228', '41a3703a-dde2-46ce-96a4-2b8eb205ea48', '03d5821c-f0c0-48c4-812d-20d2e8341711'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:53 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info" returned: 0 in 0.375s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:53 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info is being set with open permissions: ugo+rw
Sep 12 21:13:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:54 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info
Sep 12 21:13:54 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Created reservations ['303f644b-239a-445b-bd52-4cc13686f8ef', 'fa70fa21-cf4b-45fa-a0c6-9e3427318b40', 'dba791ac-bc6e-49e0-836e-093d323e895d', 'a76aa108-ba4b-4e51-92d8-093df0e49b6c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:54 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:54 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:54 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:54 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:54 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.info" returned: 0 in 0.299s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2322a3e2-26be-4759-bf89-1c9c54e4c161 tempest-ProjectReaderTests-2004611754 None] Create snapshot completed successfully
Sep 12 21:13:54 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.323s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Deleted volume successfully.
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-06d05dfc-0a83-41ff-b59e-24c4a6d86b43 tempest-CreateVolumesFromImageTest-1548024110 None] Lock "cinder-6d9b7bdd-5761-4a37-9c07-773883646b64-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:54 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Deleted volume successfully.
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4550c156-f0c7-45d6-aff6-f18eaeb7aa57 tempest-VolumeImageDependencyTests-960347873 None] Lock "cinder-856e14e1-43aa-46c4-8bcb-7d48119efeed-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-e0047a49-0380-48c5-bf9f-24489a15752c-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-e0047a49-0380-48c5-bf9f-24489a15752c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-969c2597-d2d4-496b-916f-ddd2329bc7e4" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-969c2597-d2d4-496b-916f-ddd2329bc7e4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-e0047a49-0380-48c5-bf9f-24489a15752c" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-e0047a49-0380-48c5-bf9f-24489a15752c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Deleting offline snapshot e0047a49-0380-48c5-bf9f-24489a15752c of volume 969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] snapshot_file for this snap is: volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8d8bf-d434-4cda-a852-7999868e4932]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:55 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c
Sep 12 21:13:55 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:55 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c" returned: 0 in 0.410s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969c2597-d2d4-496b-916f-ddd2329bc7e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:13:55 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9805e9-f04c-4233-ab17-872873ce723a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:55 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4
Sep 12 21:13:55 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:55 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4" returned: 0 in 0.459s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:55 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c
Sep 12 21:13:55 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:56 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c" returned: 0 in 0.488s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:56 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c
Sep 12 21:13:56 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:56 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4.e0047a49-0380-48c5-bf9f-24489a15752c" returned: 0 in 0.345s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-e0047a49-0380-48c5-bf9f-24489a15752c" released by "_delete_snapshot" :: held 1.838s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-969c2597-d2d4-496b-916f-ddd2329bc7e4" released by "delete_snapshot" :: held 1.861s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Created reservations ['f43f245c-745a-4bc2-9d60-d76cc7d47ef9', 'ab365015-6a86-46f4-adb2-95718e4806cf', 'adbabf33-991b-45ca-a3c8-633de6308b4a', '087d5010-552a-460d-8841-8912158dce12'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:56 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Delete snapshot completed successfully.
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-87f44307-1155-4707-9ab6-2a504cebff20 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-e0047a49-0380-48c5-bf9f-24489a15752c-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:56 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-969c2597-d2d4-496b-916f-ddd2329bc7e4-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Lock "cinder-969c2597-d2d4-496b-916f-ddd2329bc7e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-969c2597-d2d4-496b-916f-ddd2329bc7e4" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-969c2597-d2d4-496b-916f-ddd2329bc7e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c21ce4-fb7d-4129-ac3f-6b7afff81912]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:57 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4
Sep 12 21:13:57 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:57 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4" returned: 0 in 0.500s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:57 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4
Sep 12 21:13:57 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Flow 'volume_create_manager' (36e06691-6690-4782-beeb-f4abb9713362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc928506-5c13-42f2-8507-2d645166793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc928506-5c13-42f2-8507-2d645166793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-776687246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e25a800fc1f48dcb1e311ccf13fb1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:58Z,use_quota=True,user_id='0f7ffb4826704d8ebee4bd240d65da3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c791369-dd5f-49a6-87b0-bbc054f65f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c791369-dd5f-49a6-87b0-bbc054f65f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7ac3ee-3d56-4f6a-ba77-758d11286e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7ac3ee-3d56-4f6a-ba77-758d11286e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f', 'volume_name': 'volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee3602-e2ea-4237-acc1-769c72f34520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee3602-e2ea-4237-acc1-769c72f34520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6fa9d6-48cc-41ac-b8d0-5d8107addf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Volume 1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f', 'volume_size': 1}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-776687246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e25a800fc1f48dcb1e311ccf13fb1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:58Z,use_quota=True,user_id='0f7ffb4826704d8ebee4bd240d65da3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Creating volume 1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:57 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:57 devstack sudo[108292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f 1073741824
Sep 12 21:13:57 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:57 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-969c2597-d2d4-496b-916f-ddd2329bc7e4" returned: 0 in 0.337s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-969c2597-d2d4-496b-916f-ddd2329bc7e4" released by "delete_volume" :: held 0.926s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Created reservations ['de6c03ef-64c1-4fff-9026-0231c46af665', '2d9c7bfb-60ae-4807-b136-7b0062acf238', 'bd5f440d-223d-4be6-8344-19b67ea4a5c4', '175ed202-c38f-46cb-ae1a-2a2ce677e9c6'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:58 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:13:58 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:58 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.361s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:13:58 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Deleted volume successfully.
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-5f87ae82-f69f-413e-9fcc-a94bd917baab tempest-ProjectReaderTests-2004611754 None] Lock "cinder-969c2597-d2d4-496b-916f-ddd2329bc7e4-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:13:58 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f 1073741824" returned: 0 in 0.799s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:58 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:58 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f
Sep 12 21:13:58 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (e4961717-f6cf-4a11-90e3-a0aa577cdfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e8a451-efe9-4a55-b2c8-5b5c8b540ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e8a451-efe9-4a55-b2c8-5b5c8b540ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555104600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2be32b2-3555-47a6-b6ef-2997f791fb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:59Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c83c9dc-df30-4c5a-84ed-23f7a596dd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c83c9dc-df30-4c5a-84ed-23f7a596dd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d79339-e0d1-4317-a065-51aa53f00c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d79339-e0d1-4317-a065-51aa53f00c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2be32b2-3555-47a6-b6ef-2997f791fb23', 'volume_name': 'volume-c2be32b2-3555-47a6-b6ef-2997f791fb23', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5533eebe-b0c3-451c-bfe7-5048f084d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5533eebe-b0c3-451c-bfe7-5048f084d225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dffe00-3fd2-4cc4-b930-d4b9f377f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Volume c2be32b2-3555-47a6-b6ef-2997f791fb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2be32b2-3555-47a6-b6ef-2997f791fb23', 'volume_size': 1}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-5a89e873-a99c-4132-9bab-eb5ce6da20b0 tempest-ProjectAdminTests-289704351 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1777687072754, 'free_capacity_gb': 1773.1777687072754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87624) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f" returned: 0 in 0.345s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555104600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2be32b2-3555-47a6-b6ef-2997f791fb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:59Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Creating volume c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:13:59 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 1073741824
Sep 12 21:13:59 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (3a648103-d106-4aee-948c-9f5ac90cfd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf9b56c-8abd-497e-bfac-f8d691616e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6fa9d6-48cc-41ac-b8d0-5d8107addf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e05383-fa74-4c35-a020-8c9b1b37c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf9b56c-8abd-497e-bfac-f8d691616e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271765161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b23f65-4c4e-42ba-96b1-de77dff48834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:59Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f79eae-175e-4482-803e-63c7fd3eae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f79eae-175e-4482-803e-63c7fd3eae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea49763-8e46-409b-a1ef-6f188d26d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea49763-8e46-409b-a1ef-6f188d26d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b23f65-4c4e-42ba-96b1-de77dff48834', 'volume_name': 'volume-24b23f65-4c4e-42ba-96b1-de77dff48834', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71b3e39-793d-41d4-a83e-f95d66529001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71b3e39-793d-41d4-a83e-f95d66529001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d387c9-0dd7-4423-80a8-d0560eedbdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume 24b23f65-4c4e-42ba-96b1-de77dff48834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b23f65-4c4e-42ba-96b1-de77dff48834', 'volume_size': 1}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Volume volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f (1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f): created successfully
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e05383-fa74-4c35-a020-8c9b1b37c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Flow 'volume_create_manager' (36e06691-6690-4782-beeb-f4abb9713362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a1a98853-4b5e-4cae-b72a-1167fba25c28 tempest-ProjectReaderTests-88037998 None] Created volume successfully.
Sep 12 21:13:59 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 1073741824" returned: 0 in 0.418s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:59 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23
Sep 12 21:13:59 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:59 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23" returned: 0 in 0.264s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271765161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b23f65-4c4e-42ba-96b1-de77dff48834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:13:59Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating volume 24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:13:59 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 1073741824
Sep 12 21:13:59 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dffe00-3fd2-4cc4-b930-d4b9f377f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2be32b2-3555-47a6-b6ef-2997f791fb23', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42f54df-e681-4d5c-be3d-382da16182a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:13:59 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Volume volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 (c2be32b2-3555-47a6-b6ef-2997f791fb23): created successfully
Sep 12 21:13:59 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42f54df-e681-4d5c-be3d-382da16182a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (e4961717-f6cf-4a11-90e3-a0aa577cdfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-32cc29cc-649e-4587-90bf-7d9aabc79ccd tempest-ProjectReaderTests-2004611754 None] Created volume successfully.
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Acquiring lock "cinder-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Lock "cinder-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Acquiring lock "cinder-quobyte-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Lock "cinder-quobyte-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[36297cc7-427f-4ad1-83a6-01314e5a6f1d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:00 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 1073741824" returned: 0 in 0.541s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=189,cinder:UPDATE=243,cinder:DELETE=22,cinder:INSERT=73 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:00 devstack sudo[108319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f
Sep 12 21:14:00 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:00 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834
Sep 12 21:14:00 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:00 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834" returned: 0 in 0.271s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d387c9-0dd7-4423-80a8-d0560eedbdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b23f65-4c4e-42ba-96b1-de77dff48834', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d0bed2-4527-43e0-ad42-fafe4749ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:00 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume volume-24b23f65-4c4e-42ba-96b1-de77dff48834 (24b23f65-4c4e-42ba-96b1-de77dff48834): created successfully
Sep 12 21:14:00 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d0bed2-4527-43e0-ad42-fafe4749ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (3a648103-d106-4aee-948c-9f5ac90cfd4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f" returned: 0 in 0.451s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-af00a15f-2a9c-4e37-89c9-af4741435e95 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created volume successfully.
Sep 12 21:14:00 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f
Sep 12 21:14:00 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:01 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Lock "cinder-quobyte-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f" released by "delete_volume" :: held 0.824s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Creating offline snapshot 8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 of volume c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d441d-9f8b-420a-ad04-b74e3b8e9015]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Created reservations ['e29eaa71-1b61-4de6-a3ab-d62ea665268f', '3bd593f4-646b-4652-bb00-c985ea445561', '7dc44dfa-8f6e-4143-bdb3-c3477df5846d', 'b1f41c82-5ea8-4c2c-898a-e2857a136fd9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:01 devstack sudo[108330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23
Sep 12 21:14:01 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:01 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:01 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:01 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:01 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23" returned: 0 in 0.488s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.283s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:01 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Deleted volume successfully.
Sep 12 21:14:01 devstack sudo[108338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 1G
Sep 12 21:14:01 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-95d80cb9-fde5-4f56-852e-8b4142de6630 tempest-ProjectReaderTests-88037998 None] Lock "cinder-1a55b1a6-606e-4b82-bf0e-8cb6d35f4f5f-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:02 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 1G" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:02 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363
Sep 12 21:14:02 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:02 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" returned: 0 in 0.312s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:02 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 is being set with open permissions: ugo+rw
Sep 12 21:14:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:02 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363
Sep 12 21:14:02 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:02 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" returned: 0 in 0.286s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:02 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info
Sep 12 21:14:02 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:03 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Flow 'volume_create_manager' (03e2ce50-36cf-4720-b3ab-d5c70003b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f997924a-1357-4ff3-8b0b-53993b3a3cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info" returned: 0 in 0.342s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:03 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info is being set with open permissions: ugo+rw
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f997924a-1357-4ff3-8b0b-53993b3a3cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5659548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce75a85-5b28-41e3-b47d-2056442ad401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e25a800fc1f48dcb1e311ccf13fb1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:03Z,use_quota=True,user_id='0f7ffb4826704d8ebee4bd240d65da3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:03 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info
Sep 12 21:14:03 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14bc939-959e-4559-a07b-c5414ce700e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14bc939-959e-4559-a07b-c5414ce700e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270b8624-078f-45f6-ad23-26d0ca742ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270b8624-078f-45f6-ad23-26d0ca742ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce75a85-5b28-41e3-b47d-2056442ad401', 'volume_name': 'volume-5ce75a85-5b28-41e3-b47d-2056442ad401', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ffce42-70ce-4223-911b-071c349834fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ffce42-70ce-4223-911b-071c349834fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63be39d2-c0e5-4602-bb88-bdd59b79c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:03 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Volume 5ce75a85-5b28-41e3-b47d-2056442ad401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce75a85-5b28-41e3-b47d-2056442ad401', 'volume_size': 1}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:03 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.info" returned: 0 in 0.304s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.071s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating offline snapshot d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 of volume 24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:03 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d9ddf9af-3510-4760-9803-5dc601220aad tempest-ProjectReaderTests-2004611754 None] Create snapshot completed successfully
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203048c-e19f-44a2-a9ab-cbacff844fae]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:03 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834
Sep 12 21:14:03 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:03 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:03 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 1G
Sep 12 21:14:03 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:04 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 1G" returned: 0 in 0.421s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b23f65-4c4e-42ba-96b1-de77dff48834 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:04 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b23f65-4c4e-42ba-96b1-de77dff48834 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574
Sep 12 21:14:04 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-8b345bbb-de5b-4a5f-9c24-ca6f4dd03363-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-8b345bbb-de5b-4a5f-9c24-ca6f4dd03363-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-c2be32b2-3555-47a6-b6ef-2997f791fb23" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-c2be32b2-3555-47a6-b6ef-2997f791fb23" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Deleting offline snapshot 8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 of volume c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] snapshot_file for this snap is: volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd148f-3139-4313-8d36-15011bc2618f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:04 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b23f65-4c4e-42ba-96b1-de77dff48834 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" returned: 0 in 0.365s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:04 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 is being set with open permissions: ugo+rw
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:04 devstack sudo[108412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574
Sep 12 21:14:04 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:04 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363
Sep 12 21:14:04 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:04 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" returned: 0 in 0.304s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:05 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" returned: 0 in 0.495s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2be32b2-3555-47a6-b6ef-2997f791fb23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:05 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info
Sep 12 21:14:05 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d01567c-89f0-4442-955d-ca5afbfdad52]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:05 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23
Sep 12 21:14:05 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:05 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info" returned: 0 in 0.315s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:05 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info is being set with open permissions: ugo+rw
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:05 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info
Sep 12 21:14:05 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:05 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23" returned: 0 in 0.398s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:05 devstack sudo[108431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363
Sep 12 21:14:05 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:05 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.info" returned: 0 in 0.280s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.434s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5659548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce75a85-5b28-41e3-b47d-2056442ad401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e25a800fc1f48dcb1e311ccf13fb1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:03Z,use_quota=True,user_id='0f7ffb4826704d8ebee4bd240d65da3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Creating volume 5ce75a85-5b28-41e3-b47d-2056442ad401 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:05 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:05 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401 1073741824
Sep 12 21:14:05 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e7ea6a39-dd80-471e-a7bb-82a79072fdb6 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Create snapshot completed successfully
Sep 12 21:14:05 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" returned: 0 in 0.377s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:05 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363
Sep 12 21:14:05 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:06 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401 1073741824" returned: 0 in 0.463s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:06 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23.8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" returned: 0 in 0.302s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-8b345bbb-de5b-4a5f-9c24-ca6f4dd03363" released by "_delete_snapshot" :: held 1.699s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-c2be32b2-3555-47a6-b6ef-2997f791fb23" released by "delete_snapshot" :: held 1.732s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:06 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401
Sep 12 21:14:06 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Created reservations ['c7c748ce-0a90-4ba4-a219-88acaf8aa4c5', '606c0d58-abbc-45cf-b385-506f0477550a', '13e88ec6-b7db-426d-bd8a-ac4f9396ece8', 'ec3c521b-bc2d-4d37-982a-3db1cd01485c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Delete snapshot completed successfully.
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2b6bb0ed-240a-4706-a47a-b8739bd93b78 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-8b345bbb-de5b-4a5f-9c24-ca6f4dd03363-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:06 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401" returned: 0 in 0.267s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63be39d2-c0e5-4602-bb88-bdd59b79c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce75a85-5b28-41e3-b47d-2056442ad401', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c2728a-bd9b-473a-8104-bed9571c32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:06 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Volume volume-5ce75a85-5b28-41e3-b47d-2056442ad401 (5ce75a85-5b28-41e3-b47d-2056442ad401): created successfully
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c2728a-bd9b-473a-8104-bed9571c32b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Flow 'volume_create_manager' (03e2ce50-36cf-4720-b3ab-d5c70003b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c082f65c-5804-48d8-9e64-981b4bbe2c92 tempest-ProjectReaderTests-88037998 None] Created volume successfully.
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-c2be32b2-3555-47a6-b6ef-2997f791fb23-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Lock "cinder-c2be32b2-3555-47a6-b6ef-2997f791fb23-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-c2be32b2-3555-47a6-b6ef-2997f791fb23" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-c2be32b2-3555-47a6-b6ef-2997f791fb23" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb04d6e9-f3c6-48e1-8461-5ae91fdb5177]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:06 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23
Sep 12 21:14:06 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (22c44943-c708-4880-ade6-e4f5b78217ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:07 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef812b8-3054-4354-9744-045b34a471a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23" returned: 0 in 0.467s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef812b8-3054-4354-9744-045b34a471a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125302971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ae8311-b704-4966-90e8-60ff166b2704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:07Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c00bf1-b821-4d10-9fad-486ff3a731c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c00bf1-b821-4d10-9fad-486ff3a731c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4599a663-8a9e-4c16-a8c1-d067b007d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4599a663-8a9e-4c16-a8c1-d067b007d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ae8311-b704-4966-90e8-60ff166b2704', 'volume_name': 'volume-d9ae8311-b704-4966-90e8-60ff166b2704', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db68e9cd-63c2-4e9c-b285-5478d164fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db68e9cd-63c2-4e9c-b285-5478d164fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37814c82-91ae-462a-aec4-a158b3c6776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume d9ae8311-b704-4966-90e8-60ff166b2704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ae8311-b704-4966-90e8-60ff166b2704', 'volume_size': 1}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125302971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ae8311-b704-4966-90e8-60ff166b2704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:07Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating volume d9ae8311-b704-4966-90e8-60ff166b2704 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:07 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704 1073741824
Sep 12 21:14:07 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:07 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-c2be32b2-3555-47a6-b6ef-2997f791fb23" returned: 0 in 0.495s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Acquiring lock "cinder-5ce75a85-5b28-41e3-b47d-2056442ad401-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-c2be32b2-3555-47a6-b6ef-2997f791fb23" released by "delete_volume" :: held 1.078s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Lock "cinder-5ce75a85-5b28-41e3-b47d-2056442ad401-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (de4b15c0-4b24-4146-9541-46da82264adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4e1e71-4d9f-473a-967a-447682524a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Acquiring lock "cinder-quobyte-5ce75a85-5b28-41e3-b47d-2056442ad401" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4e1e71-4d9f-473a-967a-447682524a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1442700952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce89c2ee-aa37-48c8-96e7-a753dbd57c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:08Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5f41d0-d9e6-4a4f-a3e3-bc1bd95dc4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5f41d0-d9e6-4a4f-a3e3-bc1bd95dc4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49860761-5a16-4a58-b14d-c5ab052923ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49860761-5a16-4a58-b14d-c5ab052923ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce89c2ee-aa37-48c8-96e7-a753dbd57c18', 'volume_name': 'volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35d71ed-d53e-488f-a2e1-f39f5b004335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35d71ed-d53e-488f-a2e1-f39f5b004335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef1d767-f36b-4a23-9828-eb24ce0feee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume ce89c2ee-aa37-48c8-96e7-a753dbd57c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18', 'volume_size': 1}
Sep 12 21:14:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Lock "cinder-quobyte-5ce75a85-5b28-41e3-b47d-2056442ad401" acquired by "delete_volume" :: waited 0.076s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Created reservations ['11536424-e8bd-49b2-ba61-632ddbf39bad', '13ed7a8b-945f-42f0-9558-fa311c3024fa', 'e0cd823a-e1cc-451d-beea-37e585f32748', 'd59dc380-7a90-4526-8394-e7e3555828e8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8948ad-db63-4f2e-90a9-49e5a6f751cd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:08 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704 1073741824" returned: 0 in 0.771s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:08 devstack sudo[108465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704
Sep 12 21:14:08 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:08 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401
Sep 12 21:14:08 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:08 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:08 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (db12f321-f4ba-407c-b663-29d0a7254503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba8192e-f9a3-48d6-b532-c4881a1b1616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba8192e-f9a3-48d6-b532-c4881a1b1616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156908792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972b0d2e-386d-4923-a62a-c00ad8d2ab35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:08Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3153a334-0f38-4ca3-942c-194c7fb491dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3153a334-0f38-4ca3-942c-194c7fb491dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c51398d-71bd-403d-84da-e59df6869fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c51398d-71bd-403d-84da-e59df6869fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972b0d2e-386d-4923-a62a-c00ad8d2ab35', 'volume_name': 'volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873640fe-3b4a-496d-9143-b3dc7da99dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873640fe-3b4a-496d-9143-b3dc7da99dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cacfee-fe72-44b5-bfd6-ce1a131d080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume 972b0d2e-386d-4923-a62a-c00ad8d2ab35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35', 'volume_size': 1}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:08 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704" returned: 0 in 0.487s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1442700952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce89c2ee-aa37-48c8-96e7-a753dbd57c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:08Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating volume ce89c2ee-aa37-48c8-96e7-a753dbd57c18 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:08 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:08 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.501s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:08 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 1073741824
Sep 12 21:14:08 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37814c82-91ae-462a-aec4-a158b3c6776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ae8311-b704-4966-90e8-60ff166b2704', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62631627-b15c-4ec5-83c2-c5715a2ead52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:08 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Deleted volume successfully.
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401" returned: 0 in 0.755s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume volume-d9ae8311-b704-4966-90e8-60ff166b2704 (d9ae8311-b704-4966-90e8-60ff166b2704): created successfully
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62631627-b15c-4ec5-83c2-c5715a2ead52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (22c44943-c708-4880-ade6-e4f5b78217ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ce7e4ecf-ec9e-431d-acdb-6216b64d59ac tempest-ProjectReaderTests-2004611754 None] Lock "cinder-c2be32b2-3555-47a6-b6ef-2997f791fb23-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:08 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401
Sep 12 21:14:08 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-22cad51b-0bda-455e-8ed4-8778c7677b66 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created volume successfully.
Sep 12 21:14:08 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (e071833f-cb49-4f16-b39e-6176c7191d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08de5b07-9231-4642-9751-79dad3020355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08de5b07-9231-4642-9751-79dad3020355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177547152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df3e144-59f7-4813-959e-21058c3c9467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:09Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5bedd2-4982-4233-8499-b504a4cf566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5bedd2-4982-4233-8499-b504a4cf566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a98c3e-3781-4249-8deb-2df47e22e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a98c3e-3781-4249-8deb-2df47e22e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df3e144-59f7-4813-959e-21058c3c9467', 'volume_name': 'volume-4df3e144-59f7-4813-959e-21058c3c9467', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce571ca-4839-4f20-a5e4-debbf49b9d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce571ca-4839-4f20-a5e4-debbf49b9d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452f0380-6977-4659-886e-26cd59520e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Volume 4df3e144-59f7-4813-959e-21058c3c9467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df3e144-59f7-4813-959e-21058c3c9467', 'volume_size': 1}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:09 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (3260f014-dc98-4e23-887f-93cacab2e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974d0c41-e69c-4486-910a-8e90a68f8af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5ce75a85-5b28-41e3-b47d-2056442ad401" returned: 0 in 0.470s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974d0c41-e69c-4486-910a-8e90a68f8af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183553614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3f30e-db29-4728-844e-2732465ffa43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:09Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219628ba-38dc-4590-956d-32ea5f8d56f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219628ba-38dc-4590-956d-32ea5f8d56f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbfe2c4-1f22-4e3f-9e8f-3c841e0abf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbfe2c4-1f22-4e3f-9e8f-3c841e0abf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a3f30e-db29-4728-844e-2732465ffa43', 'volume_name': 'volume-e7a3f30e-db29-4728-844e-2732465ffa43', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e4c2ea-2d82-4a52-a209-4455087caef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e4c2ea-2d82-4a52-a209-4455087caef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659453a4-bccf-4592-b79f-0db435645557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume e7a3f30e-db29-4728-844e-2732465ffa43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a3f30e-db29-4728-844e-2732465ffa43', 'volume_size': 1}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Lock "cinder-quobyte-5ce75a85-5b28-41e3-b47d-2056442ad401" released by "delete_volume" :: held 1.410s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 1073741824" returned: 0 in 0.725s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:09 devstack sudo[108484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18
Sep 12 21:14:09 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Created reservations ['23972654-dca2-4823-9ace-1d5155ce24e6', '95c2f0a6-574c-41ec-a4e2-f0f53ae11d04', '029a539f-d422-4b7c-8d28-14e19c562934', 'b7fcf2fc-8383-48c3-9c57-c069102ff480'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:09 devstack sudo[108486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:09 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:09 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156908792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972b0d2e-386d-4923-a62a-c00ad8d2ab35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:08Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating volume 972b0d2e-386d-4923-a62a-c00ad8d2ab35 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:09 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 1073741824
Sep 12 21:14:09 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef1d767-f36b-4a23-9828-eb24ce0feee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4067c2b3-528d-46c1-aaaa-e1ee9b4ffef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 (ce89c2ee-aa37-48c8-96e7-a753dbd57c18): created successfully
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4067c2b3-528d-46c1-aaaa-e1ee9b4ffef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (de4b15c0-4b24-4146-9541-46da82264adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (2f7241c0-99b7-4e4c-81ad-465de25d4832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:09 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b09185-a958-402a-a36c-ce75baee10d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-35f4c89d-98c9-4bdb-a1de-2874eee7413f tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created volume successfully.
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.316s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b09185-a958-402a-a36c-ce75baee10d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546481704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:10Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759d8313-097e-487a-94a5-ae49b14b53f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759d8313-097e-487a-94a5-ae49b14b53f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02929e67-2266-4b4e-9603-8999f0c2ed03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02929e67-2266-4b4e-9603-8999f0c2ed03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3', 'volume_name': 'volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6909cf-df2a-42fd-92eb-8c965b540b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6909cf-df2a-42fd-92eb-8c965b540b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1ad6f8-400f-4798-b9cd-a7566d5422e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3', 'volume_size': 1}
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:09 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Deleted volume successfully.
Sep 12 21:14:09 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (42115e41-881d-40e8-ac86-359f2d5f0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1da06ad-3ab8-4734-9611-cf3a66e51238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f8bfb07b-f4fb-4201-9f88-8a2e3556978c tempest-ProjectReaderTests-88037998 None] Lock "cinder-5ce75a85-5b28-41e3-b47d-2056442ad401-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1da06ad-3ab8-4734-9611-cf3a66e51238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-936480242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3043f1b7-e3fb-4a72-80db-dfdf767b6842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:10Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d15829-5578-423b-9245-322e42015532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d15829-5578-423b-9245-322e42015532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc86571-fa07-4783-82fc-aabc75e341d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc86571-fa07-4783-82fc-aabc75e341d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3043f1b7-e3fb-4a72-80db-dfdf767b6842', 'volume_name': 'volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75369f6d-57d0-4db8-8886-cb5a16135481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75369f6d-57d0-4db8-8886-cb5a16135481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89225cd-f892-4faa-8c7f-a52745547c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Volume 3043f1b7-e3fb-4a72-80db-dfdf767b6842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842', 'volume_size': 1}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:10 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 1073741824" returned: 0 in 0.476s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=219,cinder:UPDATE=293,cinder:INSERT=74,cinder:DELETE=24 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:10 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35
Sep 12 21:14:10 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:10 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35" returned: 0 in 0.268s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177547152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df3e144-59f7-4813-959e-21058c3c9467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:09Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Creating volume 4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:10 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cacfee-fe72-44b5-bfd6-ce1a131d080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b614836-ca2e-4f96-8826-b3fd837d645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:10 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 1073741824
Sep 12 21:14:10 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:10 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 (972b0d2e-386d-4923-a62a-c00ad8d2ab35): created successfully
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b614836-ca2e-4f96-8826-b3fd837d645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:10 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (db12f321-f4ba-407c-b663-29d0a7254503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:10 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-36d2e6fd-1793-4a80-baeb-2927269bcc0b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created volume successfully.
Sep 12 21:14:11 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 1073741824" returned: 0 in 0.473s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:11 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467
Sep 12 21:14:11 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:11 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467" returned: 0 in 0.264s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183553614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a3f30e-db29-4728-844e-2732465ffa43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:09Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating volume e7a3f30e-db29-4728-844e-2732465ffa43 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:11 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452f0380-6977-4659-886e-26cd59520e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df3e144-59f7-4813-959e-21058c3c9467', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:11 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43 1073741824
Sep 12 21:14:11 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1099135b-4e8c-4f50-bc52-cf7da2049aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:11 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Volume volume-4df3e144-59f7-4813-959e-21058c3c9467 (4df3e144-59f7-4813-959e-21058c3c9467): created successfully
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1099135b-4e8c-4f50-bc52-cf7da2049aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (e071833f-cb49-4f16-b39e-6176c7191d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d51eba32-037c-4995-86af-4d6f4005ed97 tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:14:11 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43 1073741824" returned: 0 in 0.560s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:11 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:12 devstack sudo[108514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43
Sep 12 21:14:12 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:12 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43" returned: 0 in 0.281s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546481704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4cc2144495404b90ba49433930e8ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:10Z,use_quota=True,user_id='b9bfa1e02a384009a989b4801431c8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Creating volume b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:12 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659453a4-bccf-4592-b79f-0db435645557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a3f30e-db29-4728-844e-2732465ffa43', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df554798-2a85-4b49-87af-0d4034dd416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:12 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 1073741824
Sep 12 21:14:12 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:12 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume volume-e7a3f30e-db29-4728-844e-2732465ffa43 (e7a3f30e-db29-4728-844e-2732465ffa43): created successfully
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df554798-2a85-4b49-87af-0d4034dd416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (3260f014-dc98-4e23-887f-93cacab2e120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:12 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7f428af9-fde1-4b70-b1da-1f9fff857266 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created volume successfully.
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:12 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 1073741824" returned: 0 in 0.479s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:12 devstack sudo[108524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3
Sep 12 21:14:12 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:13 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3" returned: 0 in 0.251s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.997s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-936480242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3043f1b7-e3fb-4a72-80db-dfdf767b6842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:10Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Creating volume 3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:13 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1ad6f8-400f-4798-b9cd-a7566d5422e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc530925-e73d-47e7-a60d-fdb8991c4b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:13 devstack sudo[108527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 1073741824
Sep 12 21:14:13 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Volume volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 (b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3): created successfully
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc530925-e73d-47e7-a60d-fdb8991c4b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Flow 'volume_create_manager' (2f7241c0-99b7-4e4c-81ad-465de25d4832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bf826e9b-724a-4e0e-bedb-d7895eb71baf tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created volume successfully.
Sep 12 21:14:13 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 1073741824" returned: 0 in 0.427s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:13 devstack sudo[108532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842
Sep 12 21:14:13 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:13 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.388s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89225cd-f892-4faa-8c7f-a52745547c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f7da55-8f9e-4fd9-b40a-5ec07aa523f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Creating offline snapshot fc863f16-8727-4318-b07c-fb3272d1ddb5 of volume 4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:13 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Volume volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 (3043f1b7-e3fb-4a72-80db-dfdf767b6842): created successfully
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f7da55-8f9e-4fd9-b40a-5ec07aa523f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (42115e41-881d-40e8-ac86-359f2d5f0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75efd7d-db98-47ac-b7ea-57995efecf75]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f6ad5c61-9c7d-4634-bbb6-e699dad8b974 tempest-ProjectReaderTests-2004611754 None] Created volume successfully.
Sep 12 21:14:13 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467
Sep 12 21:14:13 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3" acquired by "delete_volume" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d42af71-038d-4c9d-88af-c3283ab0ab74]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:14 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3
Sep 12 21:14:14 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:14 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467" returned: 0 in 0.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:14 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 1G
Sep 12 21:14:14 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:14 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3" returned: 0 in 0.409s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:14 devstack sudo[108549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3
Sep 12 21:14:14 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:14 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 1G" returned: 0 in 0.481s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df3e144-59f7-4813-959e-21058c3c9467 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:14 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df3e144-59f7-4813-959e-21058c3c9467 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5
Sep 12 21:14:14 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:14 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3" returned: 0 in 0.279s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3" released by "delete_volume" :: held 0.744s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:14 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['dcdc6c60-0862-4f69-9a0a-7205641f2add', 'b0813c1e-185b-4236-a7f8-4cfa5210115a', 'f1c2ebd3-6862-4128-84c6-883f3eb26e05', '7cca8dd1-4175-460d-9d26-bd1a6426df1b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:15 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:15 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:15 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4df3e144-59f7-4813-959e-21058c3c9467 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5" returned: 0 in 0.389s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:15 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 is being set with open permissions: ugo+rw
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:15 devstack sudo[108561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5
Sep 12 21:14:15 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-e7a3f30e-db29-4728-844e-2732465ffa43-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-e7a3f30e-db29-4728-844e-2732465ffa43-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:15 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.343s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleted volume successfully.
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-e7a3f30e-db29-4728-844e-2732465ffa43" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-e7a3f30e-db29-4728-844e-2732465ffa43" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-1fae607f-71d4-4b82-8510-388e9559769d tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-b5a8f5c6-46ea-4ec7-b95a-66ebe9cf0ea3-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[48200943-fab6-4f39-83f2-a83b1a04e54b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:15 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:15 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43
Sep 12 21:14:15 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:15 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info
Sep 12 21:14:15 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:15 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43" returned: 0 in 0.379s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:15 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info" returned: 0 in 0.275s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:15 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info is being set with open permissions: ugo+rw
Sep 12 21:14:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:15 devstack sudo[108574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43
Sep 12 21:14:15 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:15 devstack sudo[108575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info
Sep 12 21:14:15 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:16 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e7a3f30e-db29-4728-844e-2732465ffa43" returned: 0 in 0.256s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-e7a3f30e-db29-4728-844e-2732465ffa43" released by "delete_volume" :: held 0.687s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:16 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.info" returned: 0 in 0.269s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Creating offline snapshot e94331e1-361a-4192-84a0-42cda526ccd7 of volume 3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-05637d1e-3026-48d4-9857-939b3bf51890 tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ed6a63-910b-4d40-88da-ce7ec6f93cfc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['2d760e96-4fb9-4beb-a17a-704e5d7cec5c', '36e3c49d-c796-4551-8223-3f0f6eef2a79', '7e3959d9-f1f1-4cc4-bcc7-70ae311836b1', '20c5e768-595a-4500-8ecc-8417fb0acbb5'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:16 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842
Sep 12 21:14:16 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:16 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:16 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-972b0d2e-386d-4923-a62a-c00ad8d2ab35-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-972b0d2e-386d-4923-a62a-c00ad8d2ab35-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-972b0d2e-386d-4923-a62a-c00ad8d2ab35" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-fc863f16-8727-4318-b07c-fb3272d1ddb5-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-972b0d2e-386d-4923-a62a-c00ad8d2ab35" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Lock "cinder-fc863f16-8727-4318-b07c-fb3272d1ddb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-4df3e144-59f7-4813-959e-21058c3c9467" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:16 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af755ae-dc56-490a-8568-bcffed7b3e3c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:16 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.432s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842" returned: 0 in 0.542s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-4df3e144-59f7-4813-959e-21058c3c9467" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-fc863f16-8727-4318-b07c-fb3272d1ddb5" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleted volume successfully.
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-fc863f16-8727-4318-b07c-fb3272d1ddb5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:16 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 1G
Sep 12 21:14:16 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot fc863f16-8727-4318-b07c-fb3272d1ddb5 of volume 4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7e2bfcd1-5fc3-47fb-bc8d-202aa31b521b tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-e7a3f30e-db29-4728-844e-2732465ffa43-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6889aa2d-0fe8-4ddd-bd71-493cee2a282c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:16 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35
Sep 12 21:14:16 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:16 devstack sudo[108592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5
Sep 12 21:14:16 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:17 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:17 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35
Sep 12 21:14:17 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:17 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 1G" returned: 0 in 0.516s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:17 devstack sudo[108606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7
Sep 12 21:14:17 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:17 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5" returned: 0 in 0.516s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4df3e144-59f7-4813-959e-21058c3c9467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8990cd9-8e76-4b4e-81e9-3cf2ddc60f28]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:17 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-972b0d2e-386d-4923-a62a-c00ad8d2ab35" returned: 0 in 0.333s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-972b0d2e-386d-4923-a62a-c00ad8d2ab35" released by "delete_volume" :: held 0.830s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:17 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467
Sep 12 21:14:17 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['ff7ffc27-4db1-4a27-bd52-435f0b773a98', '1386c7b5-fb25-4e00-b1ad-3f78cdb1a23d', '330fcfd6-6db9-4a0d-8848-062090b0690d', '303cfd9c-95b8-4916-a53b-6e2d2b46eb35'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:17 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7" returned: 0 in 0.440s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:17 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 is being set with open permissions: ugo+rw
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:17 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:17 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:17 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7
Sep 12 21:14:17 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-ce89c2ee-aa37-48c8-96e7-a753dbd57c18-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-ce89c2ee-aa37-48c8-96e7-a753dbd57c18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-ce89c2ee-aa37-48c8-96e7-a753dbd57c18" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-ce89c2ee-aa37-48c8-96e7-a753dbd57c18" acquired by "delete_volume" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2430e650-cae0-4ef5-a215-0294faa75415]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:17 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467" returned: 0 in 0.597s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:18 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:18 devstack sudo[108623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5
Sep 12 21:14:18 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleted volume successfully.
Sep 12 21:14:18 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18
Sep 12 21:14:18 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c51ec7f8-f612-4ac3-9db8-8da400d8819a tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-972b0d2e-386d-4923-a62a-c00ad8d2ab35-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:18 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7" returned: 0 in 0.405s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:18 devstack sudo[108627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info
Sep 12 21:14:18 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:18 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18" returned: 0 in 0.488s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:18 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18
Sep 12 21:14:18 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:18 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info is being set with open permissions: ugo+rw
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:18 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5" returned: 0 in 0.461s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:18 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info
Sep 12 21:14:18 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:18 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5
Sep 12 21:14:18 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:18 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ce89c2ee-aa37-48c8-96e7-a753dbd57c18" returned: 0 in 0.288s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-ce89c2ee-aa37-48c8-96e7-a753dbd57c18" released by "delete_volume" :: held 0.835s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:18 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.info" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-89e7bf95-ea89-4a20-9b9b-7d696509feea tempest-ProjectReaderTests-2004611754 None] Create snapshot completed successfully
Sep 12 21:14:18 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467.fc863f16-8727-4318-b07c-fb3272d1ddb5" returned: 0 in 0.324s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-fc863f16-8727-4318-b07c-fb3272d1ddb5" released by "_delete_snapshot" :: held 2.042s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['3a66ee27-0a89-411a-9601-f8b07ee77c22', '67c15b60-27ea-4d45-b897-17b5630098c2', '2f0e80ed-3a02-4bcd-a60f-80a8852eb10e', '406506e5-d0ce-45f0-a2ac-644f5c4669b9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-4df3e144-59f7-4813-959e-21058c3c9467" released by "delete_snapshot" :: held 2.084s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:18 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Created reservations ['96ab8100-5347-4f33-a421-d72d3ddc4f88', '420d1fd2-613b-4cde-8d4e-7a65ef7abdc2', 'e9228c52-4aad-48a2-9716-5ff931e2eb2b', '710184c0-3cd6-46d4-9122-486fed5d0301'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:18 devstack sudo[108646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:18 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-d9ae8311-b704-4966-90e8-60ff166b2704-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-d9ae8311-b704-4966-90e8-60ff166b2704-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-6402c92f-356b-457c-afa8-e8540e798bd8 tempest-ProjectMemberTests-792499713 None] Lock "cinder-fc863f16-8727-4318-b07c-fb3272d1ddb5-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-d9ae8311-b704-4966-90e8-60ff166b2704" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-d9ae8311-b704-4966-90e8-60ff166b2704" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fabe60a-2747-48a7-9a33-7b3a3a8e8bc7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:19 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.294s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:19 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleted volume successfully.
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-daa89d77-a0ff-4f0e-8ae3-1f6106fbc867 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-ce89c2ee-aa37-48c8-96e7-a753dbd57c18-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:19 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704
Sep 12 21:14:19 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-e94331e1-361a-4192-84a0-42cda526ccd7-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-e94331e1-361a-4192-84a0-42cda526ccd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-3043f1b7-e3fb-4a72-80db-dfdf767b6842" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-3043f1b7-e3fb-4a72-80db-dfdf767b6842" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-e94331e1-361a-4192-84a0-42cda526ccd7" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-e94331e1-361a-4192-84a0-42cda526ccd7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Deleting offline snapshot e94331e1-361a-4192-84a0-42cda526ccd7 of volume 3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] snapshot_file for this snap is: volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05f2111-86d1-4073-b6dc-f4692442b4f3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:19 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704" returned: 0 in 0.423s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:19 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704
Sep 12 21:14:19 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:19 devstack sudo[108654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7
Sep 12 21:14:19 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-4df3e144-59f7-4813-959e-21058c3c9467-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Lock "cinder-4df3e144-59f7-4813-959e-21058c3c9467-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:19 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-d9ae8311-b704-4966-90e8-60ff166b2704" returned: 0 in 0.383s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-d9ae8311-b704-4966-90e8-60ff166b2704" released by "delete_volume" :: held 0.863s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:20 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7" returned: 0 in 0.474s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-4df3e144-59f7-4813-959e-21058c3c9467" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dbea86-8b65-4efa-9130-198865d9ac1d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-4df3e144-59f7-4813-959e-21058c3c9467" acquired by "delete_volume" :: waited 0.041s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['bbf7cebd-059d-4417-9cd5-05882709e82c', 'c9f7b5ba-2b8a-4310-a6fe-4b492bfbf08c', 'e67fe119-b555-40d6-a5d8-b04397b8421c', 'caa3c26a-75b0-4792-aab7-e3df7e7b6e8b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1130e5f-4fe9-44d8-bbf9-d52b9be931ae]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:20 devstack sudo[108669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842
Sep 12 21:14:20 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:20 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467
Sep 12 21:14:20 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:20 devstack sudo[108672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:20 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:20 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842" returned: 0 in 0.455s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:20 devstack sudo[108681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7
Sep 12 21:14:20 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:20 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.328s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleted volume successfully.
Sep 12 21:14:20 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467" returned: 0 in 0.450s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:20 devstack sudo[108685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-57fc38b1-483b-41dc-8144-474e9167f2d0 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-d9ae8311-b704-4966-90e8-60ff166b2704-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:20 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:20 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-4df3e144-59f7-4813-959e-21058c3c9467" returned: 0 in 0.258s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7" returned: 0 in 0.367s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-4df3e144-59f7-4813-959e-21058c3c9467" released by "delete_volume" :: held 0.821s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:20 devstack sudo[108691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7
Sep 12 21:14:20 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:20 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Created reservations ['c18c30de-19b5-482a-b7af-9dd16bf094d9', '4ddd85a7-b3c1-4edf-9d69-222c6f2e213a', 'df7226bb-e611-4277-946d-328b6c388e6f', 'cdb022ad-ff44-4d9d-8fbb-86ded723f62e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:21 devstack sudo[108693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:21 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:21 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842.e94331e1-361a-4192-84a0-42cda526ccd7" returned: 0 in 0.348s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-e94331e1-361a-4192-84a0-42cda526ccd7" released by "_delete_snapshot" :: held 1.787s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-d8aa9d28-c69d-4e2d-9217-a60ac8b5e574-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-3043f1b7-e3fb-4a72-80db-dfdf767b6842" released by "delete_snapshot" :: held 1.834s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-d8aa9d28-c69d-4e2d-9217-a60ac8b5e574-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-24b23f65-4c4e-42ba-96b1-de77dff48834" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:21 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-24b23f65-4c4e-42ba-96b1-de77dff48834" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleting offline snapshot d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 of volume 24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] snapshot_file for this snap is: volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b88471-3797-4a2f-9618-86ca0bc565fd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7b7df3c7-4db4-43ca-b7fe-d4e1835f3fc7 tempest-ProjectMemberTests-792499713 None] Lock "cinder-4df3e144-59f7-4813-959e-21058c3c9467-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Created reservations ['b84e0439-3c73-4899-bc46-688ab3c4c1ca', '3a2221e2-c9f3-4997-a65f-094a12efc420', 'b4b0f615-67fd-4129-a953-89fe886f2e2b', 'c0bd6834-6cbe-4496-965a-428a33ae5b49'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:21 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Delete snapshot completed successfully.
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f95d2265-9e33-470e-920a-76602fd29ae8 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-e94331e1-361a-4192-84a0-42cda526ccd7-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:21 devstack sudo[108697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574
Sep 12 21:14:21 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (ca1a94e4-b3f1-4b49-ad2d-7e7872fc8b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20dd6ff-8486-464d-bb05-2fb19fa05cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20dd6ff-8486-464d-bb05-2fb19fa05cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393523990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03079a86-1356-42c7-b38d-b3c46b63561e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:22Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707d2456-7081-4f1a-9319-d3e197c1f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707d2456-7081-4f1a-9319-d3e197c1f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356a3892-7157-42fa-a0da-231bde0890f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356a3892-7157-42fa-a0da-231bde0890f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03079a86-1356-42c7-b38d-b3c46b63561e', 'volume_name': 'volume-03079a86-1356-42c7-b38d-b3c46b63561e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5747d60f-fd1b-4882-a4ca-af8f8048eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5747d60f-fd1b-4882-a4ca-af8f8048eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6ea0d4-acd8-4bc9-a7cb-2f43996830af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:21 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Volume 03079a86-1356-42c7-b38d-b3c46b63561e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03079a86-1356-42c7-b38d-b3c46b63561e', 'volume_size': 1}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393523990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03079a86-1356-42c7-b38d-b3c46b63561e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:22Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Creating volume 03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:21 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:21 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" returned: 0 in 0.427s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24b23f65-4c4e-42ba-96b1-de77dff48834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:21 devstack sudo[108703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e 1073741824
Sep 12 21:14:21 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc564073-81fa-4f98-acf5-7a80672b6ac4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:22 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834
Sep 12 21:14:22 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:22 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834" returned: 0 in 0.393s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:22 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e 1073741824" returned: 0 in 0.472s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:22 devstack sudo[108715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574
Sep 12 21:14:22 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:22 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e
Sep 12 21:14:22 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-3043f1b7-e3fb-4a72-80db-dfdf767b6842-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-3043f1b7-e3fb-4a72-80db-dfdf767b6842-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:22 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6ea0d4-acd8-4bc9-a7cb-2f43996830af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03079a86-1356-42c7-b38d-b3c46b63561e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fad3306-e15b-4848-80c9-e7a56bb01666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-3043f1b7-e3fb-4a72-80db-dfdf767b6842" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:22 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" returned: 0 in 0.520s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-3043f1b7-e3fb-4a72-80db-dfdf767b6842" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:22 devstack sudo[108723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574
Sep 12 21:14:22 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Volume volume-03079a86-1356-42c7-b38d-b3c46b63561e (03079a86-1356-42c7-b38d-b3c46b63561e): created successfully
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fad3306-e15b-4848-80c9-e7a56bb01666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (ca1a94e4-b3f1-4b49-ad2d-7e7872fc8b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafffb50-cb31-460c-9221-8d2bf41b7b5b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-beb14a18-1453-4560-ba55-a3ea6887e8bf tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:14:23 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842
Sep 12 21:14:23 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:23 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834.d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-d8aa9d28-c69d-4e2d-9217-a60ac8b5e574" released by "_delete_snapshot" :: held 1.747s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-24b23f65-4c4e-42ba-96b1-de77dff48834" released by "delete_snapshot" :: held 1.792s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['254cdee3-512a-4baf-87b2-b4af0f9a20ea', '22e159f2-fd9b-4f2d-970c-963c83049f14', '23e2c04b-ba04-48b5-8f02-08e5d4d53d6c', '5a4bf794-1a6a-4ee8-8b67-08f7763415bb'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:23 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Delete snapshot completed successfully.
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f0f6a8b7-0344-49c0-8826-59dc89bc752e tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-d8aa9d28-c69d-4e2d-9217-a60ac8b5e574-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:23 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842" returned: 0 in 0.400s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:23 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842
Sep 12 21:14:23 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-24b23f65-4c4e-42ba-96b1-de77dff48834-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-24b23f65-4c4e-42ba-96b1-de77dff48834-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "cinder-quobyte-24b23f65-4c4e-42ba-96b1-de77dff48834" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-24b23f65-4c4e-42ba-96b1-de77dff48834" acquired by "delete_volume" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:23 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-3043f1b7-e3fb-4a72-80db-dfdf767b6842" returned: 0 in 0.292s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c100c5-00fc-4796-9fa7-47f0a7a22958]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-3043f1b7-e3fb-4a72-80db-dfdf767b6842" released by "delete_volume" :: held 0.775s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Created reservations ['4e5013a4-46f2-4f9f-aca6-4dac82a88e74', '08d4c72e-1071-42d2-81d3-b67bfbd12196', 'cd794d1c-d6b1-412e-a5a9-e5cdafa8ccfc', '4a18cd9d-0de1-4356-b533-32f8a54776d0'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:23 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834
Sep 12 21:14:23 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:23 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:23 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:24 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834" returned: 0 in 0.603s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:24 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.468s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:24 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834
Sep 12 21:14:24 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:24 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Deleted volume successfully.
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-becfd203-17bf-4451-82ca-f07f08597012 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-3043f1b7-e3fb-4a72-80db-dfdf767b6842-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Creating offline snapshot a28bf2b7-da59-4c95-ade7-bf08699a4ddc of volume 03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e215b3f-31d3-4c74-baae-784e1fc075cf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:24 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-24b23f65-4c4e-42ba-96b1-de77dff48834" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:24 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e
Sep 12 21:14:24 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-quobyte-24b23f65-4c4e-42ba-96b1-de77dff48834" released by "delete_volume" :: held 1.113s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (93c3a594-b0f0-42f8-9f70-487203ace7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d53523-c4c6-482d-9932-23f1b4e2a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d53523-c4c6-482d-9932-23f1b4e2a184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-548390572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba23b130-4042-46b7-83c8-5abf7eea223d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:25Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fc0972-b449-4b00-9672-0c8322b4abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fc0972-b449-4b00-9672-0c8322b4abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aae1080-9e5a-425e-9488-bf4283623558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aae1080-9e5a-425e-9488-bf4283623558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba23b130-4042-46b7-83c8-5abf7eea223d', 'volume_name': 'volume-ba23b130-4042-46b7-83c8-5abf7eea223d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40732f39-362e-43fe-bb8a-6ba5edffba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40732f39-362e-43fe-bb8a-6ba5edffba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a7a35d-7f58-4e89-bb07-27bbcf0ae2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:24 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Volume ba23b130-4042-46b7-83c8-5abf7eea223d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba23b130-4042-46b7-83c8-5abf7eea223d', 'volume_size': 1}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Created reservations ['262a724b-cc6c-463a-a441-213e0b5e4645', 'd63e1990-5b70-401e-817c-d7d96bcfe255', '67c5bebf-d7ed-46b0-bbbd-abda4b574e80', '060cc155-b3f0-420a-945d-d9ecb31d0805'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:24 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:24 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:25 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e" returned: 0 in 0.479s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:25 devstack sudo[108752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc 1G
Sep 12 21:14:25 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:25 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.251s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Deleted volume successfully.
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-410d4fa1-cc1d-4697-827d-307f1fa97189 tempest-CreateVolumesFromSnapshotTest-1121084863 None] Lock "cinder-24b23f65-4c4e-42ba-96b1-de77dff48834-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:25 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc 1G" returned: 0 in 0.465s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03079a86-1356-42c7-b38d-b3c46b63561e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:25 devstack sudo[108759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03079a86-1356-42c7-b38d-b3c46b63561e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc
Sep 12 21:14:25 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:25 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03079a86-1356-42c7-b38d-b3c46b63561e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc" returned: 0 in 0.307s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:25 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc is being set with open permissions: ugo+rw
Sep 12 21:14:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:25 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc
Sep 12 21:14:25 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:26 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc" returned: 0 in 0.276s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:26 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info
Sep 12 21:14:26 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:26 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:26 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info is being set with open permissions: ugo+rw
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:26 devstack sudo[108770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info
Sep 12 21:14:26 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:26 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.info" returned: 0 in 0.290s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-548390572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba23b130-4042-46b7-83c8-5abf7eea223d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332e69ffb65448098b9195a9744b8e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:25Z,use_quota=True,user_id='f6d764686c364dfd934d0aa53363f378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Creating volume ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:26 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:26 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-22d9b052-9c05-4a3e-983c-c2ebbd059668 tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:14:26 devstack sudo[108773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d 1073741824
Sep 12 21:14:26 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:27 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d 1073741824" returned: 0 in 0.592s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:27 devstack sudo[108779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d
Sep 12 21:14:27 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-a28bf2b7-da59-4c95-ade7-bf08699a4ddc-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Lock "cinder-a28bf2b7-da59-4c95-ade7-bf08699a4ddc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-03079a86-1356-42c7-b38d-b3c46b63561e" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-03079a86-1356-42c7-b38d-b3c46b63561e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-a28bf2b7-da59-4c95-ade7-bf08699a4ddc" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-a28bf2b7-da59-4c95-ade7-bf08699a4ddc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot a28bf2b7-da59-4c95-ade7-bf08699a4ddc of volume 03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bbbf92-74d9-4a93-aa24-5b8798e9f24d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:27 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d" returned: 0 in 0.404s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a7a35d-7f58-4e89-bb07-27bbcf0ae2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba23b130-4042-46b7-83c8-5abf7eea223d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612a0324-6f97-4a21-86cd-7a5e1fb6e0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:27 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Volume volume-ba23b130-4042-46b7-83c8-5abf7eea223d (ba23b130-4042-46b7-83c8-5abf7eea223d): created successfully
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612a0324-6f97-4a21-86cd-7a5e1fb6e0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:27 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Flow 'volume_create_manager' (93c3a594-b0f0-42f8-9f70-487203ace7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7026236f-164c-4f32-adbd-63807ae16e3e tempest-ProjectReaderTests-2004611754 None] Created volume successfully.
Sep 12 21:14:27 devstack sudo[108782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc
Sep 12 21:14:27 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:28 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc" returned: 0 in 0.471s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:28 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03079a86-1356-42c7-b38d-b3c46b63561e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:28 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c888cf-b1df-46b5-ba26-6d6ba13f636f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:28 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e
Sep 12 21:14:28 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:28 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e" returned: 0 in 0.438s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:28 devstack sudo[108794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc
Sep 12 21:14:28 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:29 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc" returned: 0 in 0.465s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:29 devstack sudo[108799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc
Sep 12 21:14:29 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Creating offline snapshot 44951004-a359-4fe9-8db0-8ee25f0d57c1 of volume ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6a4ee-4115-4053-bc0e-9257c0abe159]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:29 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:29 devstack sudo[108801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d
Sep 12 21:14:29 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e.a28bf2b7-da59-4c95-ade7-bf08699a4ddc" returned: 0 in 0.313s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-a28bf2b7-da59-4c95-ade7-bf08699a4ddc" released by "_delete_snapshot" :: held 1.839s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-03079a86-1356-42c7-b38d-b3c46b63561e" released by "delete_snapshot" :: held 1.874s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Created reservations ['0277b52f-4c04-4027-9539-0fa092200b33', '9e2123ef-f926-45dc-a7aa-afce5f369558', '317a3ea8-69a5-47c5-b3b5-87303b5e23d4', 'cf07dc9b-db3c-4594-83bb-e8a6c2e34b3c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e06202ef-764d-4562-b106-c893bd3d5423 tempest-ProjectMemberTests-792499713 None] Lock "cinder-a28bf2b7-da59-4c95-ade7-bf08699a4ddc-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:29 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d" returned: 0 in 0.530s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:29 devstack sudo[108807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 1G
Sep 12 21:14:29 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-03079a86-1356-42c7-b38d-b3c46b63561e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-03079a86-1356-42c7-b38d-b3c46b63561e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-03079a86-1356-42c7-b38d-b3c46b63561e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-03079a86-1356-42c7-b38d-b3c46b63561e" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b91492-01ce-4960-bd7e-4b4f66ef9184]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:30 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e
Sep 12 21:14:30 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:30 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 1G" returned: 0 in 0.637s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba23b130-4042-46b7-83c8-5abf7eea223d -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:30 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba23b130-4042-46b7-83c8-5abf7eea223d -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1
Sep 12 21:14:30 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:30 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e" returned: 0 in 0.533s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:30 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e
Sep 12 21:14:30 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:30 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba23b130-4042-46b7-83c8-5abf7eea223d -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1" returned: 0 in 0.404s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:30 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 is being set with open permissions: ugo+rw
Sep 12 21:14:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:30 devstack sudo[108826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1
Sep 12 21:14:30 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:31 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-03079a86-1356-42c7-b38d-b3c46b63561e" returned: 0 in 0.390s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-03079a86-1356-42c7-b38d-b3c46b63561e" released by "delete_volume" :: held 1.015s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Created reservations ['10ef4d46-6c3f-4082-b6ed-c7b7e382b0ec', 'e565478c-c3ab-426e-b8a5-dc4a27c4bcaa', '0e56c7f7-df46-4b86-9a79-fc2e16456a40', '1de13b48-09a6-426a-90aa-0de36909072b'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:31 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:31 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info
Sep 12 21:14:31 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:31 devstack sudo[108832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:31 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:31 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:31 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info is being set with open permissions: ugo+rw
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:31 devstack sudo[108835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info
Sep 12 21:14:31 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:31 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.406s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:31 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-15de2aad-c4e0-4166-9ef9-24a8a16aab01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-03079a86-1356-42c7-b38d-b3c46b63561e-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:31 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.info" returned: 0 in 0.284s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-06554bad-7f1b-4683-a5a3-e92c98655771 tempest-ProjectReaderTests-2004611754 None] Create snapshot completed successfully
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-44951004-a359-4fe9-8db0-8ee25f0d57c1-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-44951004-a359-4fe9-8db0-8ee25f0d57c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-ba23b130-4042-46b7-83c8-5abf7eea223d" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-ba23b130-4042-46b7-83c8-5abf7eea223d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-44951004-a359-4fe9-8db0-8ee25f0d57c1" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-44951004-a359-4fe9-8db0-8ee25f0d57c1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Deleting offline snapshot 44951004-a359-4fe9-8db0-8ee25f0d57c1 of volume ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] snapshot_file for this snap is: volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa0f218-6d4a-4288-902a-96ab87e0b53c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:32 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1
Sep 12 21:14:32 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (273d2ad0-b01c-4b8d-8efa-1e886c855b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45fa93b-eecc-4e52-a179-c70fc2925b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45fa93b-eecc-4e52-a179-c70fc2925b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377401595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79498fb8-ce38-4e6f-9b20-a2227b9d9a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:33Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7e861f-89b7-434d-83a2-855b30980e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7e861f-89b7-434d-83a2-855b30980e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9fd876-b3f2-4cfb-b1b6-0ea8a57b8e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:32 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9fd876-b3f2-4cfb-b1b6-0ea8a57b8e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79498fb8-ce38-4e6f-9b20-a2227b9d9a07', 'volume_name': 'volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2994ee4a-dfbf-464a-ab1e-6f79a5261356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2994ee4a-dfbf-464a-ab1e-6f79a5261356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcd4c69-46ef-44db-8c3b-04d2cfe224bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:33 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Volume 79498fb8-ce38-4e6f-9b20-a2227b9d9a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07', 'volume_size': 1}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377401595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79498fb8-ce38-4e6f-9b20-a2227b9d9a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:33Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Creating volume 79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:33 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:33 devstack sudo[108843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 1073741824
Sep 12 21:14:33 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:33 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1" returned: 0 in 0.500s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba23b130-4042-46b7-83c8-5abf7eea223d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7701f19-1edb-44cf-b775-c606ea089faa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:33 devstack sudo[108848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d
Sep 12 21:14:33 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:33 devstack sudo[108853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:33 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:33 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 1073741824" returned: 0 in 0.621s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:33 devstack sudo[108859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07
Sep 12 21:14:33 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:33 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d" returned: 0 in 0.557s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:33 devstack sudo[108861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1
Sep 12 21:14:33 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:33 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.504s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:33 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" returned: 0 in 0.303s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcd4c69-46ef-44db-8c3b-04d2cfe224bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c6d248-6d20-4ef3-a8f6-f596b45609fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:34 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Volume volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 (79498fb8-ce38-4e6f-9b20-a2227b9d9a07): created successfully
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c6d248-6d20-4ef3-a8f6-f596b45609fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (273d2ad0-b01c-4b8d-8efa-1e886c855b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2cc4928a-c657-4c06-99a1-b8fad1c1fe2b tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:14:34 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1" returned: 0 in 0.424s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:34 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1
Sep 12 21:14:34 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:34 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d.44951004-a359-4fe9-8db0-8ee25f0d57c1" returned: 0 in 0.333s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-44951004-a359-4fe9-8db0-8ee25f0d57c1" released by "_delete_snapshot" :: held 1.971s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-ba23b130-4042-46b7-83c8-5abf7eea223d" released by "delete_snapshot" :: held 2.001s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Created reservations ['97b100c6-15de-44cb-87f6-5e62bf7d7940', '512250f3-8117-490b-84d7-85281505859c', '095fa952-9219-45a2-8599-7e88250c11aa', 'c7ab0c2e-aca1-49c2-b2fa-63c0bf40a96e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Delete snapshot completed successfully.
Sep 12 21:14:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-2c54a336-4e86-4bb3-9eab-9662a7adc639 tempest-ProjectReaderTests-2004611754 None] Lock "cinder-44951004-a359-4fe9-8db0-8ee25f0d57c1-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Creating offline snapshot 1808e61e-f78f-45d1-bb97-173850858230 of volume 79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0a7e4-7e9b-4921-afd7-0eae44e528a0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:35 devstack sudo[108871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07
Sep 12 21:14:35 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:35 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" returned: 0 in 0.421s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:35 devstack sudo[108876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 1G
Sep 12 21:14:35 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-ba23b130-4042-46b7-83c8-5abf7eea223d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-ba23b130-4042-46b7-83c8-5abf7eea223d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "cinder-quobyte-ba23b130-4042-46b7-83c8-5abf7eea223d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-ba23b130-4042-46b7-83c8-5abf7eea223d" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e9eeb-be9c-48f6-a118-73c0f62c96c3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:36 devstack sudo[108881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d
Sep 12 21:14:36 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:36 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 1G" returned: 0 in 0.492s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:36 devstack sudo[108884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230
Sep 12 21:14:36 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:36 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d" returned: 0 in 0.437s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:36 devstack sudo[108890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d
Sep 12 21:14:36 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:36 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230" returned: 0 in 0.415s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:36 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 is being set with open permissions: ugo+rw
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:36 devstack sudo[108895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230
Sep 12 21:14:36 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:36 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ba23b130-4042-46b7-83c8-5abf7eea223d" returned: 0 in 0.272s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-quobyte-ba23b130-4042-46b7-83c8-5abf7eea223d" released by "delete_volume" :: held 0.793s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Created reservations ['eb746c6a-b73a-4aff-8ecb-ba72b27e0f0d', 'f3015fdc-1b9b-4ed5-b7ed-f5b8db0e0c3c', '0c375b0a-88ba-4c0f-a135-96034d5ad0dc', '336e76da-d80b-41c9-9739-4d7ee0c6b8e3'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:36 devstack sudo[108899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:36 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:36 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230" returned: 0 in 0.378s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:37 devstack sudo[108901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info
Sep 12 21:14:37 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:37 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.346s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Deleted volume successfully.
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-04ce3d38-010a-4a23-83d9-2782c13a8d2e tempest-ProjectReaderTests-2004611754 None] Lock "cinder-ba23b130-4042-46b7-83c8-5abf7eea223d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:37 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info" returned: 0 in 0.465s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:37 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info is being set with open permissions: ugo+rw
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:37 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info
Sep 12 21:14:37 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:37 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.info" returned: 0 in 0.303s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:37 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:37 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0d194298-8bb1-4b09-a3b0-b8e812f1d2eb tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-1808e61e-f78f-45d1-bb97-173850858230-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-1808e61e-f78f-45d1-bb97-173850858230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-1808e61e-f78f-45d1-bb97-173850858230" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-1808e61e-f78f-45d1-bb97-173850858230" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot 1808e61e-f78f-45d1-bb97-173850858230 of volume 79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6655ae03-6f99-4ea4-9e84-761dd0301b59]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:38 devstack sudo[108908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230
Sep 12 21:14:38 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:38 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230" returned: 0 in 0.381s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3688ab-248c-43c2-9f0b-b742fa751070]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:38 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:39 devstack sudo[108913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07
Sep 12 21:14:39 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:39 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" returned: 0 in 0.447s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:39 devstack sudo[108918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230
Sep 12 21:14:39 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:39 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:39 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:39 devstack sudo[108924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230
Sep 12 21:14:39 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:40 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07.1808e61e-f78f-45d1-bb97-173850858230" returned: 0 in 0.428s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-1808e61e-f78f-45d1-bb97-173850858230" released by "_delete_snapshot" :: held 1.818s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" released by "delete_snapshot" :: held 1.848s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Created reservations ['20cf2d0b-dc7e-44e4-98a8-689fda135ba6', 'a75bcd40-5174-46a0-893b-b844abd924d3', 'df7c8ab9-7181-462a-b6ec-aeae942bbd79', '1862655b-d337-486e-834b-248fbab014f8'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:40 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7dad816a-7b43-4290-bbad-4ea2357d8c01 tempest-ProjectMemberTests-792499713 None] Lock "cinder-1808e61e-f78f-45d1-bb97-173850858230-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-79498fb8-ce38-4e6f-9b20-a2227b9d9a07-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-79498fb8-ce38-4e6f-9b20-a2227b9d9a07-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2add8-8da6-4ace-bb85-3fc4b6c1bfa2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:40 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:40 devstack sudo[108927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07
Sep 12 21:14:40 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:41 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" returned: 0 in 0.491s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:41 devstack sudo[108933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07
Sep 12 21:14:41 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:41 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" returned: 0 in 0.387s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-79498fb8-ce38-4e6f-9b20-a2227b9d9a07" released by "delete_volume" :: held 0.956s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Created reservations ['16182222-1dcc-403f-a533-fe6be48d2129', 'fb867280-cfbc-4612-a617-e07e342f42a5', '54508b1a-825d-46bd-9b79-bafd53147cea', 'f771ed7f-1f31-43ee-816a-919871d8e446'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:41 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:41 devstack sudo[108936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:41 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:42 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:42 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.297s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:42 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:42 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:14:42 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-ef98e9f2-fed0-484b-add4-03a701abccf6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-79498fb8-ce38-4e6f-9b20-a2227b9d9a07-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (14cb4d24-55c0-471c-9294-30e01a788d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abad2f4-43c1-441f-a84d-a9a675cca018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abad2f4-43c1-441f-a84d-a9a675cca018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083241141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93654884-8724-489c-b2d3-01a604796a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:43Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59906adb-74c3-4ea0-b4ed-87ffa6d371dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59906adb-74c3-4ea0-b4ed-87ffa6d371dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be0a13-815a-46dc-be76-6e171e82e6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be0a13-815a-46dc-be76-6e171e82e6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93654884-8724-489c-b2d3-01a604796a5d', 'volume_name': 'volume-93654884-8724-489c-b2d3-01a604796a5d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d1582c-cdcd-4c0f-9042-acb60d82d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d1582c-cdcd-4c0f-9042-acb60d82d812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78a8ad2-7081-459e-9137-1b7d97b9c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Volume 93654884-8724-489c-b2d3-01a604796a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93654884-8724-489c-b2d3-01a604796a5d', 'volume_size': 1}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083241141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93654884-8724-489c-b2d3-01a604796a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:43Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Creating volume 93654884-8724-489c-b2d3-01a604796a5d {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:43 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:43 devstack sudo[108940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d 1073741824
Sep 12 21:14:43 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (41258070-093f-4922-837c-dc42e7b29f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01e8884-c5c7-4b79-b8c5-fa1eb143fdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01e8884-c5c7-4b79-b8c5-fa1eb143fdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126867257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955bfbad-c240-4fcd-ae89-7194ef2babbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:44Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1654ae-a5f8-4e77-8dfe-76e495db3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1654ae-a5f8-4e77-8dfe-76e495db3acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f738abdd-a0f6-4e14-91e5-feeae9d26ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f738abdd-a0f6-4e14-91e5-feeae9d26ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955bfbad-c240-4fcd-ae89-7194ef2babbc', 'volume_name': 'volume-955bfbad-c240-4fcd-ae89-7194ef2babbc', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c57fab9-4cca-4906-97bd-be45b278950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c57fab9-4cca-4906-97bd-be45b278950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18805419-c83f-4768-91f9-827beece8ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:43 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Volume 955bfbad-c240-4fcd-ae89-7194ef2babbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955bfbad-c240-4fcd-ae89-7194ef2babbc', 'volume_size': 1}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:43 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d 1073741824" returned: 0 in 0.628s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:43 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:43 devstack sudo[108946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d
Sep 12 21:14:43 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:44 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d" returned: 0 in 0.285s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126867257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955bfbad-c240-4fcd-ae89-7194ef2babbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:44Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Creating volume 955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:44 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78a8ad2-7081-459e-9137-1b7d97b9c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93654884-8724-489c-b2d3-01a604796a5d', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a256755-032b-413f-b530-aaa68bc2e950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:44 devstack sudo[108949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc 1073741824
Sep 12 21:14:44 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:44 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Volume volume-93654884-8724-489c-b2d3-01a604796a5d (93654884-8724-489c-b2d3-01a604796a5d): created successfully
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a256755-032b-413f-b530-aaa68bc2e950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (14cb4d24-55c0-471c-9294-30e01a788d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:44 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-aee594d0-9c91-4cff-a622-4caff21aadb2 tempest-ProjectReaderTests-1598873464 None] Created volume successfully.
Sep 12 21:14:44 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc 1073741824" returned: 0 in 0.569s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:44 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:44 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc
Sep 12 21:14:44 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:45 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18805419-c83f-4768-91f9-827beece8ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955bfbad-c240-4fcd-ae89-7194ef2babbc', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35864e45-9bd9-4ad2-810d-b65ec5dc4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:45 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Volume volume-955bfbad-c240-4fcd-ae89-7194ef2babbc (955bfbad-c240-4fcd-ae89-7194ef2babbc): created successfully
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35864e45-9bd9-4ad2-810d-b65ec5dc4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (41258070-093f-4922-837c-dc42e7b29f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:45 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-0bf7575c-4d33-466b-802d-f0c72d948663 tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-93654884-8724-489c-b2d3-01a604796a5d-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-93654884-8724-489c-b2d3-01a604796a5d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-quobyte-93654884-8724-489c-b2d3-01a604796a5d" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-93654884-8724-489c-b2d3-01a604796a5d" acquired by "delete_volume" :: waited 0.037s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecf09b1-6640-45e3-822e-88adb491eeb2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:45 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:45 devstack sudo[108958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d
Sep 12 21:14:45 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Creating offline snapshot 9e56b232-2f84-466b-aa96-38ccc94641df of volume 955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ed122-be6e-42aa-9cfe-c8fcc3deda9c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:46 devstack sudo[108960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc
Sep 12 21:14:46 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:46 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d" returned: 0 in 0.509s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:46 devstack sudo[108965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d
Sep 12 21:14:46 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:46 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc" returned: 0 in 0.464s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:46 devstack sudo[108971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df 1G
Sep 12 21:14:46 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:46 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-93654884-8724-489c-b2d3-01a604796a5d" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-93654884-8724-489c-b2d3-01a604796a5d" released by "delete_volume" :: held 0.941s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Created reservations ['528dfc43-4d79-4f80-a165-a12403a6ca35', '05654fdb-5a11-4b3a-9ba0-ec3e47036fb9', 'c12438cf-ff54-4ba5-97fe-ce1c00907aa0', '6171417a-633e-4506-96d3-249a42f5f14f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:46 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:46 devstack sudo[108977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:46 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Flow 'volume_create_manager' (962935bf-69e8-4537-a025-03495c3d2e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:47 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6c5bda-21ce-496e-b68c-263bb41984a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df 1G" returned: 0 in 0.558s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955bfbad-c240-4fcd-ae89-7194ef2babbc -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:47 devstack sudo[108980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955bfbad-c240-4fcd-ae89-7194ef2babbc -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6c5bda-21ce-496e-b68c-263bb41984a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1642713814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48276679-efbe-4823-8edd-852df5b61848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823b101bc8a940939a0d76839d6fc34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:47Z,use_quota=True,user_id='9a70590721324863ae20edde355a40ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:47 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568d371c-2193-4779-afca-28972b7fccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568d371c-2193-4779-afca-28972b7fccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07196f24-df2d-498c-88b6-d9d5439636be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07196f24-df2d-498c-88b6-d9d5439636be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48276679-efbe-4823-8edd-852df5b61848', 'volume_name': 'volume-48276679-efbe-4823-8edd-852df5b61848', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d7278d-c02d-44f5-a55a-ee04f673f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d7278d-c02d-44f5-a55a-ee04f673f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca57a806-9f6c-4165-9fde-b0d064e4eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:47 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Volume 48276679-efbe-4823-8edd-852df5b61848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48276679-efbe-4823-8edd-852df5b61848', 'volume_size': 1}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:47 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.336s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:47 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Deleted volume successfully.
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-7d0f5e06-b035-4e7f-ab92-457bd71ce7d2 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-93654884-8724-489c-b2d3-01a604796a5d-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:47 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955bfbad-c240-4fcd-ae89-7194ef2babbc -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df" returned: 0 in 0.309s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:47 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df is being set with open permissions: ugo+rw
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:47 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df
Sep 12 21:14:47 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:47 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df" returned: 0 in 0.243s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:47 devstack sudo[108989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info
Sep 12 21:14:47 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:47 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info" returned: 0 in 0.261s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:47 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info is being set with open permissions: ugo+rw
Sep 12 21:14:47 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:48 devstack sudo[108992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info
Sep 12 21:14:48 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:48 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.info" returned: 0 in 0.262s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1642713814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48276679-efbe-4823-8edd-852df5b61848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823b101bc8a940939a0d76839d6fc34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:47Z,use_quota=True,user_id='9a70590721324863ae20edde355a40ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Creating volume 48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:48 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:48 devstack sudo[108995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 1073741824
Sep 12 21:14:48 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:48 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f37e04d3-e5c3-4eba-b69a-47239b1def3f tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (565ab42b-e969-4fb4-b407-f64ff468536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b2a3c0-b095-4a06-bc48-fd2d27efb4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b2a3c0-b095-4a06-bc48-fd2d27efb4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2052721755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b3f7b7-84dd-4a80-b134-6fbcdae13742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:48Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1a939b-6d6c-40ff-8976-376e91098d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1a939b-6d6c-40ff-8976-376e91098d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bec0108-4e30-4a60-9e9e-0b0213dbf6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bec0108-4e30-4a60-9e9e-0b0213dbf6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b3f7b7-84dd-4a80-b134-6fbcdae13742', 'volume_name': 'volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e89077-6d19-417e-8805-dac2ce0953d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e89077-6d19-417e-8805-dac2ce0953d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e920af-00fa-42f3-a807-72f2a5ae7273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:48 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Volume 16b3f7b7-84dd-4a80-b134-6fbcdae13742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742', 'volume_size': 1}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:48 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 1073741824" returned: 0 in 0.410s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:48 devstack sudo[109001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:14:48 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:48 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.239s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2052721755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b3f7b7-84dd-4a80-b134-6fbcdae13742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:48Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Creating volume 16b3f7b7-84dd-4a80-b134-6fbcdae13742 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:48 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca57a806-9f6c-4165-9fde-b0d064e4eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48276679-efbe-4823-8edd-852df5b61848', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:48 devstack sudo[109005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 1073741824
Sep 12 21:14:48 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180eb545-c711-4a4e-87f9-47abd9e10b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:48 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:49 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Volume volume-48276679-efbe-4823-8edd-852df5b61848 (48276679-efbe-4823-8edd-852df5b61848): created successfully
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180eb545-c711-4a4e-87f9-47abd9e10b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Flow 'volume_create_manager' (962935bf-69e8-4537-a025-03495c3d2e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-76bed550-988e-4ca2-89f7-c9f307e26d19 tempest-SnapshotDependencyTests-1612716757 None] Created volume successfully.
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-9e56b232-2f84-466b-aa96-38ccc94641df-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-9e56b232-2f84-466b-aa96-38ccc94641df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-955bfbad-c240-4fcd-ae89-7194ef2babbc" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-955bfbad-c240-4fcd-ae89-7194ef2babbc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-9e56b232-2f84-466b-aa96-38ccc94641df" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-9e56b232-2f84-466b-aa96-38ccc94641df" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot 9e56b232-2f84-466b-aa96-38ccc94641df of volume 955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[858dcdd7-4ea9-47a8-b47b-793bc279886f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:49 devstack sudo[109011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df
Sep 12 21:14:49 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:49 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 1073741824" returned: 0 in 0.550s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:49 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742
Sep 12 21:14:49 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:49 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df" returned: 0 in 0.407s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-955bfbad-c240-4fcd-ae89-7194ef2babbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce2e825-a9bd-4153-9d63-d7f1977bc8b6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:49 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742" returned: 0 in 0.247s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.314s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Creating offline snapshot b306558e-f608-4fbd-ac72-9c8e3c721839 of volume 48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e920af-00fa-42f3-a807-72f2a5ae7273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49913bc8-ecbd-4e97-be7f-1caa8bcfa823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d754390-e159-4672-9427-d5893c08d679]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:49 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Volume volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 (16b3f7b7-84dd-4a80-b134-6fbcdae13742): created successfully
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49913bc8-ecbd-4e97-be7f-1caa8bcfa823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:49 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (565ab42b-e969-4fb4-b407-f64ff468536d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:49 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-b35abad2-afb3-445e-9a47-6c4328b5eda6 tempest-ProjectReaderTests-1598873464 None] Created volume successfully.
Sep 12 21:14:49 devstack sudo[109019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc
Sep 12 21:14:49 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:49 devstack sudo[109020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:14:49 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:50 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc" returned: 0 in 0.367s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:50 devstack sudo[109028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df
Sep 12 21:14:50 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:50 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.371s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:50 devstack sudo[109031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 1G
Sep 12 21:14:50 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:50 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df" returned: 0 in 0.392s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-16b3f7b7-84dd-4a80-b134-6fbcdae13742-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:50 devstack sudo[109039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df
Sep 12 21:14:50 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-16b3f7b7-84dd-4a80-b134-6fbcdae13742-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-quobyte-16b3f7b7-84dd-4a80-b134-6fbcdae13742" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-16b3f7b7-84dd-4a80-b134-6fbcdae13742" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9226e548-3b12-425e-a100-c4bb71c2591c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:50 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 1G" returned: 0 in 0.483s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48276679-efbe-4823-8edd-852df5b61848 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:50 devstack sudo[109043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48276679-efbe-4823-8edd-852df5b61848 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839
Sep 12 21:14:50 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:50 devstack sudo[109042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742
Sep 12 21:14:50 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:50 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc.9e56b232-2f84-466b-aa96-38ccc94641df" returned: 0 in 0.300s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-9e56b232-2f84-466b-aa96-38ccc94641df" released by "_delete_snapshot" :: held 1.584s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-955bfbad-c240-4fcd-ae89-7194ef2babbc" released by "delete_snapshot" :: held 1.615s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Created reservations ['244ed45b-2ded-4729-a86c-a45c4f90b8dc', '2b8c6c74-f34f-4cce-a53f-f425675b0600', 'e13bd75e-542a-4d7b-88bd-49cee899386c', 'ff45ee4d-769e-45b0-8dac-3dd3a5acbf10'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:50 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48276679-efbe-4823-8edd-852df5b61848 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839" returned: 0 in 0.304s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:50 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 is being set with open permissions: ugo+rw
Sep 12 21:14:50 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:14:51 devstack sudo[109053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839
Sep 12 21:14:51 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-c44d69e0-a5d8-47bc-b3b7-feae8798e0f6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-9e56b232-2f84-466b-aa96-38ccc94641df-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:51 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742" returned: 0 in 0.394s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:51 devstack sudo[109055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742
Sep 12 21:14:51 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:51 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839" returned: 0 in 0.250s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:51 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-16b3f7b7-84dd-4a80-b134-6fbcdae13742" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:51 devstack sudo[109059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info
Sep 12 21:14:51 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-16b3f7b7-84dd-4a80-b134-6fbcdae13742" released by "delete_volume" :: held 0.686s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Created reservations ['8d3b7384-8daf-43d0-93ff-2f59f7f685be', '4393e9e9-2390-43b3-86e0-cfeb7b61ff9a', '2b69545c-eea9-49ec-bd49-7865ab94771d', '12261de1-1c3c-429f-9f6b-f4a9e5e1ea93'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-955bfbad-c240-4fcd-ae89-7194ef2babbc-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Lock "cinder-955bfbad-c240-4fcd-ae89-7194ef2babbc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-955bfbad-c240-4fcd-ae89-7194ef2babbc" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-955bfbad-c240-4fcd-ae89-7194ef2babbc" acquired by "delete_volume" :: waited 0.025s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc6709-efa8-4cfe-9500-f8fb90faa1b8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:51 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:51 devstack sudo[109064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:51 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:51 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info is being set with open permissions: ugo+rw
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:51 devstack sudo[109067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info
Sep 12 21:14:51 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:51 devstack sudo[109065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc
Sep 12 21:14:51 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:51 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.286s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Deleted volume successfully.
Sep 12 21:14:51 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bd816d40-fd69-4ae8-bdba-e1e325581692 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-16b3f7b7-84dd-4a80-b134-6fbcdae13742-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.info" returned: 0 in 0.303s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:51 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:51 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-85d148a1-b26b-4d60-9e70-868986c0764f tempest-SnapshotDependencyTests-1612716757 None] Create snapshot completed successfully
Sep 12 21:14:52 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc" returned: 0 in 0.438s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:52 devstack sudo[109076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc
Sep 12 21:14:52 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (7c592d37-4697-44f6-b80a-b38a6e913b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975a8fac-acd6-40cf-be1a-e714a622b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975a8fac-acd6-40cf-be1a-e714a622b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756509196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dceb96-c002-4c38-8b36-01c666443b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:52Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d72a70-1146-4ff9-961e-fb4844eacfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d72a70-1146-4ff9-961e-fb4844eacfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe3eaf5-9611-4631-afda-5ef229a59831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe3eaf5-9611-4631-afda-5ef229a59831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dceb96-c002-4c38-8b36-01c666443b97', 'volume_name': 'volume-a2dceb96-c002-4c38-8b36-01c666443b97', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef8a776-60be-4a61-aacf-fd0f78e2ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef8a776-60be-4a61-aacf-fd0f78e2ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0631bdd7-6982-4929-ae50-60131e6abb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:52 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Volume a2dceb96-c002-4c38-8b36-01c666443b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dceb96-c002-4c38-8b36-01c666443b97', 'volume_size': 1}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756509196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dceb96-c002-4c38-8b36-01c666443b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:52Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Creating volume a2dceb96-c002-4c38-8b36-01c666443b97 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:52 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:52 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-955bfbad-c240-4fcd-ae89-7194ef2babbc" returned: 0 in 0.285s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:52 devstack sudo[109080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97 1073741824
Sep 12 21:14:52 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-955bfbad-c240-4fcd-ae89-7194ef2babbc" released by "delete_volume" :: held 0.797s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Created reservations ['64c5c7ec-d3b5-4b6c-9311-612af28121fe', 'fbf29843-f62f-42cb-b4cc-d0573e8da00c', '339df800-086f-4c44-99c8-4a1caa55f1f9', '87dd2107-ffa0-49d1-a7b4-5162ceed1c9e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:52 devstack sudo[109082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:52 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:52 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.284s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:52 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-9ea9baba-25ba-46e5-8e40-d23d90bd8040 tempest-ProjectMemberTests-792499713 None] Lock "cinder-955bfbad-c240-4fcd-ae89-7194ef2babbc-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:52 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97 1073741824" returned: 0 in 0.506s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:52 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:52 devstack sudo[109089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97
Sep 12 21:14:52 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:53 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97" returned: 0 in 0.309s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0631bdd7-6982-4929-ae50-60131e6abb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dceb96-c002-4c38-8b36-01c666443b97', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa5ae06-dcb4-449d-be96-14488c96678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Volume volume-a2dceb96-c002-4c38-8b36-01c666443b97 (a2dceb96-c002-4c38-8b36-01c666443b97): created successfully
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa5ae06-dcb4-449d-be96-14488c96678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (7c592d37-4697-44f6-b80a-b38a6e913b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (73bb97e0-b291-432f-ae75-b8cfdc803e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6719608-2617-491f-8983-f507ba4c8b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-6e9a2d0a-310e-4d4f-b448-1ce7a69c1f56 tempest-ProjectReaderTests-1598873464 None] Created volume successfully.
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6719608-2617-491f-8983-f507ba4c8b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665425271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c20e07-7685-4402-ae4f-cf110618b671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:53Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3477ed85-47a3-4dd1-9cc1-04206ab0f232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3477ed85-47a3-4dd1-9cc1-04206ab0f232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e76c5c-819c-466e-9c16-8f36bb70c090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e76c5c-819c-466e-9c16-8f36bb70c090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c20e07-7685-4402-ae4f-cf110618b671', 'volume_name': 'volume-a5c20e07-7685-4402-ae4f-cf110618b671', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe35fa9-3745-49ee-abcd-707524bd4e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe35fa9-3745-49ee-abcd-707524bd4e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9433d9c5-1446-4298-9725-38031c1d6b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Volume a5c20e07-7685-4402-ae4f-cf110618b671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c20e07-7685-4402-ae4f-cf110618b671', 'volume_size': 1}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665425271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c20e07-7685-4402-ae4f-cf110618b671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:53Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Creating volume a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:53 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:53 devstack sudo[109092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 1073741824
Sep 12 21:14:53 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Flow 'volume_create_manager' (ccbb664c-44e7-4744-8c50-6400ad77b5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb737de-18ea-4e02-b73f-210c6d454a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb737de-18ea-4e02-b73f-210c6d454a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df9363b-1973-4430-8160-da4146c8405a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823b101bc8a940939a0d76839d6fc34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b306558e-f608-4fbd-ac72-9c8e3c721839,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:53Z,use_quota=True,user_id='9a70590721324863ae20edde355a40ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0881ef8-1584-458b-bf5d-7ab71be4b4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0881ef8-1584-458b-bf5d-7ab71be4b4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed20176-7c57-4da5-a260-4f98560f0599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed20176-7c57-4da5-a260-4f98560f0599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0df9363b-1973-4430-8160-da4146c8405a', 'volume_name': 'volume-0df9363b-1973-4430-8160-da4146c8405a', 'volume_size': 1, 'snapshot_id': 'b306558e-f608-4fbd-ac72-9c8e3c721839'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc5ef41-63a4-422f-ad5a-97b4b7482c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc5ef41-63a4-422f-ad5a-97b4b7482c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5863e8b2-8c2e-4912-a44b-cc2c215735f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:53 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Volume 0df9363b-1973-4430-8160-da4146c8405a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0df9363b-1973-4430-8160-da4146c8405a', 'volume_size': 1, 'snapshot_id': 'b306558e-f608-4fbd-ac72-9c8e3c721839'}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:53 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 1073741824" returned: 0 in 0.420s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:53 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:53 devstack sudo[109097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671
Sep 12 21:14:53 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:54 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.548s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-quobyte-b306558e-f608-4fbd-ac72-9c8e3c721839-0df9363b-1973-4430-8160-da4146c8405a" by "_create_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9433d9c5-1446-4298-9725-38031c1d6b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c20e07-7685-4402-ae4f-cf110618b671', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fdd6c1-dd18-4106-ad4a-dad68a3ea4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-b306558e-f608-4fbd-ac72-9c8e3c721839-0df9363b-1973-4430-8160-da4146c8405a" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Creating volume 0df9363b-1973-4430-8160-da4146c8405a from snapshot b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-quobyte-0df9363b-1973-4430-8160-da4146c8405a" by "_copy_volume_from_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:54 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Volume volume-a5c20e07-7685-4402-ae4f-cf110618b671 (a5c20e07-7685-4402-ae4f-cf110618b671): created successfully
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fdd6c1-dd18-4106-ad4a-dad68a3ea4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (73bb97e0-b291-432f-ae75-b8cfdc803e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-0df9363b-1973-4430-8160-da4146c8405a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] snapshot: b306558e-f608-4fbd-ac72-9c8e3c721839, volume: 0df9363b-1973-4430-8160-da4146c8405a,  {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Sep 12 21:14:54 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-1ad0d79b-896b-4554-ba04-307569a20fc5 tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8d8c9-051f-4965-a034-483f5d9b8351]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:54 devstack sudo[109100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839
Sep 12 21:14:54 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-a2dceb96-c002-4c38-8b36-01c666443b97-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-a2dceb96-c002-4c38-8b36-01c666443b97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-quobyte-a2dceb96-c002-4c38-8b36-01c666443b97" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-a2dceb96-c002-4c38-8b36-01c666443b97" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd6fe3-6bb8-40f7-832f-65ccc2a70649]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:54 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839" returned: 0 in 0.377s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48276679-efbe-4823-8edd-852df5b61848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Creating direct copy from snapshot {{(pid=87624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0802187-4d29-4e03-a5ed-2007c4addd24]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:54 devstack sudo[109104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97
Sep 12 21:14:54 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:54 devstack sudo[109106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:14:54 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:54 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97" returned: 0 in 0.368s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:54 devstack sudo[109114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97
Sep 12 21:14:54 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:54 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.355s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG cinder.utils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Path /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a not found in is_blk_device check {{(pid=87624) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Sep 12 21:14:54 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:54 devstack sudo[109117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a
Sep 12 21:14:54 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:55 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a2dceb96-c002-4c38-8b36-01c666443b97" returned: 0 in 0.253s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-a2dceb96-c002-4c38-8b36-01c666443b97" released by "delete_volume" :: held 0.662s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Created reservations ['450b6582-679e-40bb-90f2-1b1d64a27c2d', 'abcff934-dcdb-4218-b6d4-159df491e9da', '0c5ad473-ff48-4b40-938d-5c34f294840f', 'ec008c3a-b8ce-43a8-b071-36dfc7373fbd'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:55 devstack sudo[109124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:14:55 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:55 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.398s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:14:55 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Deleted volume successfully.
Sep 12 21:14:55 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-106f2df0-2923-4394-9866-a53fbb910688 tempest-ProjectReaderTests-1598873464 None] Lock "cinder-a2dceb96-c002-4c38-8b36-01c666443b97-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:14:56 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:14:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (7c5e4a91-acac-48fe-b617-a618afacdbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:14:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d27c142-ce40-456f-bcd9-5d076cf716b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d27c142-ce40-456f-bcd9-5d076cf716b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-120617861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b7f4aa-3a19-4bea-bc44-e6263df86a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:57Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed98afe-6123-42c1-a47e-c9726183bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:56 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed98afe-6123-42c1-a47e-c9726183bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8f67ff-8e57-4b71-b66d-693cc0de1b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8f67ff-8e57-4b71-b66d-693cc0de1b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b7f4aa-3a19-4bea-bc44-e6263df86a6b', 'volume_name': 'volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac2f822-52cd-4132-bb40-645383bbeed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac2f822-52cd-4132-bb40-645383bbeed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:14:57 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9a851a-901b-4a20-ab2d-670c3495c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:14:57 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Volume 06b7f4aa-3a19-4bea-bc44-e6263df86a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b', 'volume_size': 1}
Sep 12 21:14:57 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:14:59 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a" returned: 0 in 4.444s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:59 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc50637-ceeb-4a94-bfe8-b42a09bd2225]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:14:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:59 devstack sudo[109134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:14:59 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:14:59 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root
Sep 12 21:14:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.513s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:14:59 devstack cinder-volume[87624]: DEBUG cinder.image.image_utils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a {{(pid=87624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Sep 12 21:14:59 devstack cinder-volume[87624]: INFO cinder.image.image_utils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Converted 1024.00 MB image at 230.40 MB/s
Sep 12 21:14:59 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a is being set with open permissions: ugo+rw
Sep 12 21:14:59 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:14:59 devstack sudo[109139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a
Sep 12 21:14:59 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:00 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a" returned: 0 in 0.240s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-0df9363b-1973-4430-8160-da4146c8405a" released by "_copy_volume_from_snapshot" :: held 6.023s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-b306558e-f608-4fbd-ac72-9c8e3c721839-0df9363b-1973-4430-8160-da4146c8405a" released by "_create_volume_from_snapshot" :: held 6.063s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.093s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.704s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Creating offline snapshot ec604d2f-000c-4554-a94c-bc3937a96f83 of volume a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a9563d-e0b5-43eb-8db5-06c4ec2009a5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5863e8b2-8c2e-4912-a44b-cc2c215735f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df9363b-1973-4430-8160-da4146c8405a', 'volume_size': 1, 'snapshot_id': 'b306558e-f608-4fbd-ac72-9c8e3c721839'}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68860a27-ac54-4a93-b6ef-c002cb5520d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:00 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Volume volume-0df9363b-1973-4430-8160-da4146c8405a (0df9363b-1973-4430-8160-da4146c8405a): created successfully
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68860a27-ac54-4a93-b6ef-c002cb5520d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Flow 'volume_create_manager' (ccbb664c-44e7-4744-8c50-6400ad77b5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:00 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-e89f8ac7-60be-40a7-928c-efff63dbec0d tempest-SnapshotDependencyTests-1612716757 None] Created volume successfully.
Sep 12 21:15:00 devstack sudo[109142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671
Sep 12 21:15:00 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:00 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671" returned: 0 in 0.385s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:00 devstack sudo[109147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 1G
Sep 12 21:15:00 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:00 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 1G" returned: 0 in 0.385s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c20e07-7685-4402-ae4f-cf110618b671 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:00 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c20e07-7685-4402-ae4f-cf110618b671 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83
Sep 12 21:15:00 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:00 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-b306558e-f608-4fbd-ac72-9c8e3c721839-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-b306558e-f608-4fbd-ac72-9c8e3c721839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-quobyte-48276679-efbe-4823-8edd-852df5b61848" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-48276679-efbe-4823-8edd-852df5b61848" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-quobyte-b306558e-f608-4fbd-ac72-9c8e3c721839" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-b306558e-f608-4fbd-ac72-9c8e3c721839" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Deleting offline snapshot b306558e-f608-4fbd-ac72-9c8e3c721839 of volume 48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] snapshot_file for this snap is: volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2b5891-266d-4a32-9c40-09df817d3334]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:01 devstack sudo[109155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839
Sep 12 21:15:01 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:01 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c20e07-7685-4402-ae4f-cf110618b671 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83" returned: 0 in 0.332s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:01 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 is being set with open permissions: ugo+rw
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:01 devstack sudo[109160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83
Sep 12 21:15:01 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:01 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839" returned: 0 in 0.363s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48276679-efbe-4823-8edd-852df5b61848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b186bf5b-79f9-448d-aced-90fcda526a9a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:01 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83" returned: 0 in 0.262s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=263,cinder:DELETE=26,cinder:SELECT=187,cinder:INSERT=58 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:01 devstack sudo[109167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info
Sep 12 21:15:01 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:01 devstack sudo[109166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:15:01 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:01 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info" returned: 0 in 0.264s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:01 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info is being set with open permissions: ugo+rw
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:01 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info
Sep 12 21:15:01 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:01 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.375s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:01 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:01 devstack sudo[109179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839
Sep 12 21:15:01 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:02 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.info" returned: 0 in 0.259s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.975s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-120617861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b7f4aa-3a19-4bea-bc44-e6263df86a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec6ae45203d49938bd82348aa210707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:14:57Z,use_quota=True,user_id='1d1da1d7d9c541b59f1929b86d05e825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Creating volume 06b7f4aa-3a19-4bea-bc44-e6263df86a6b {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:15:02 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:02 devstack sudo[109186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b 1073741824
Sep 12 21:15:02 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4e3c137f-21e8-42e8-9789-5c584b856ccf tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:15:02 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839" returned: 0 in 0.353s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:02 devstack sudo[109188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839
Sep 12 21:15:02 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:02 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848.b306558e-f608-4fbd-ac72-9c8e3c721839" returned: 0 in 0.262s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-b306558e-f608-4fbd-ac72-9c8e3c721839" released by "_delete_snapshot" :: held 1.443s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-48276679-efbe-4823-8edd-852df5b61848" released by "delete_snapshot" :: held 1.465s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:02 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b 1073741824" returned: 0 in 0.413s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:02 devstack sudo[109195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b
Sep 12 21:15:02 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Created reservations ['1c82d8e8-4a19-4fdf-a6b8-f39037eb15d1', '58b5820e-0d48-4606-93cb-46aa946663bb', 'd53f2db9-9ee8-40b9-8508-1c2ca0ed1d73', '95fc648a-3d1c-4bbf-b0c8-dc732ec23d52'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Delete snapshot completed successfully.
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-532f98c5-ca44-42a6-8565-2b6697f69c46 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-b306558e-f608-4fbd-ac72-9c8e3c721839-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-ec604d2f-000c-4554-a94c-bc3937a96f83-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Lock "cinder-ec604d2f-000c-4554-a94c-bc3937a96f83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-a5c20e07-7685-4402-ae4f-cf110618b671" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-a5c20e07-7685-4402-ae4f-cf110618b671" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-ec604d2f-000c-4554-a94c-bc3937a96f83" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-ec604d2f-000c-4554-a94c-bc3937a96f83" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot ec604d2f-000c-4554-a94c-bc3937a96f83 of volume a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:15:02 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b" returned: 0 in 0.311s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ffbadc-d701-4e7f-b290-3caef335b7dc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9a851a-901b-4a20-ab2d-670c3495c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9716440d-c541-42e6-aca5-c6ea10853489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:02 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Volume volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b (06b7f4aa-3a19-4bea-bc44-e6263df86a6b): created successfully
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9716440d-c541-42e6-aca5-c6ea10853489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:02 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Flow 'volume_create_manager' (7c5e4a91-acac-48fe-b617-a618afacdbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:02 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-8b3b5275-bc5b-4a2f-928e-7c4e08276fb3 tempest-ProjectReaderTests-1598873464 None] Created volume successfully.
Sep 12 21:15:03 devstack sudo[109198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83
Sep 12 21:15:03 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-48276679-efbe-4823-8edd-852df5b61848-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-48276679-efbe-4823-8edd-852df5b61848-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-quobyte-48276679-efbe-4823-8edd-852df5b61848" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-48276679-efbe-4823-8edd-852df5b61848" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:03 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83" returned: 0 in 0.395s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c20e07-7685-4402-ae4f-cf110618b671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e3ec55-ca13-46ee-8252-a9911c8935cf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a35cd58-6cd3-4a6f-ad5a-92a847f1233f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:03 devstack sudo[109203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:15:03 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:03 devstack sudo[109204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671
Sep 12 21:15:03 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:03 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:03 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.369s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671" returned: 0 in 0.366s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:03 devstack sudo[109214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848
Sep 12 21:15:03 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:03 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83
Sep 12 21:15:03 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-06b7f4aa-3a19-4bea-bc44-e6263df86a6b-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:03 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:03 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-48276679-efbe-4823-8edd-852df5b61848" returned: 0 in 0.313s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Lock "cinder-06b7f4aa-3a19-4bea-bc44-e6263df86a6b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-48276679-efbe-4823-8edd-852df5b61848" released by "delete_volume" :: held 0.768s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Acquiring lock "cinder-quobyte-06b7f4aa-3a19-4bea-bc44-e6263df86a6b" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-06b7f4aa-3a19-4bea-bc44-e6263df86a6b" acquired by "delete_volume" :: waited 0.029s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[553769ac-288d-49e3-baf5-97029f73a2fe]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Created reservations ['6a87f786-d70f-4db9-8e38-327354c9f954', 'ff364bed-daae-4eeb-bd3b-92e19eba4332', 'fbd7c56e-bf73-4397-b2c1-da3edd985a51', '459b3d73-2a77-4673-8795-c304703d6a38'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:04 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83" returned: 0 in 0.483s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:04 devstack sudo[109224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83
Sep 12 21:15:04 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:04 devstack sudo[109223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b
Sep 12 21:15:04 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:04 devstack sudo[109227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:04 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-0df9363b-1973-4430-8160-da4146c8405a-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-0df9363b-1973-4430-8160-da4146c8405a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "cinder-quobyte-0df9363b-1973-4430-8160-da4146c8405a" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-0df9363b-1973-4430-8160-da4146c8405a" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8a6fb-6e57-4c3e-9c5e-a0c427356bce]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:04 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671.ec604d2f-000c-4554-a94c-bc3937a96f83" returned: 0 in 0.338s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-ec604d2f-000c-4554-a94c-bc3937a96f83" released by "_delete_snapshot" :: held 1.682s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-a5c20e07-7685-4402-ae4f-cf110618b671" released by "delete_snapshot" :: held 1.708s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:04 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.325s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Deleted volume successfully.
Sep 12 21:15:04 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:04 devstack sudo[109230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a
Sep 12 21:15:04 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b" returned: 0 in 0.485s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-883beb16-2332-4ace-aad3-47b3a0eb00a2 tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-48276679-efbe-4823-8edd-852df5b61848-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Created reservations ['81138da7-34e8-40f1-9efe-5a9a8d59bea3', 'f7d83eb9-5842-498f-9aef-fe7c076db76c', '92340b23-7588-467e-8612-e64e9df18653', 'bd22c64b-1fdb-4a4d-9896-97649febbbed'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:04 devstack sudo[109236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b
Sep 12 21:15:04 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:04 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-92673540-9ee1-4f08-8645-bbe3452fd8dd tempest-ProjectMemberTests-792499713 None] Lock "cinder-ec604d2f-000c-4554-a94c-bc3937a96f83-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:04 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a" returned: 0 in 0.388s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:04 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-06b7f4aa-3a19-4bea-bc44-e6263df86a6b" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:04 devstack sudo[109242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a
Sep 12 21:15:04 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Lock "cinder-quobyte-06b7f4aa-3a19-4bea-bc44-e6263df86a6b" released by "delete_volume" :: held 0.821s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:04 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Created reservations ['42e02809-4469-4b87-b001-9915e668bd9e', '4a0d87fc-67f3-40dd-bfec-4c6ea879044b', '8843c585-7c95-4fd9-b885-471abfbc8162', 'e2d61e67-4565-44d5-a0ba-99513a11a0ef'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-a5c20e07-7685-4402-ae4f-cf110618b671-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-a5c20e07-7685-4402-ae4f-cf110618b671-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-a5c20e07-7685-4402-ae4f-cf110618b671" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:05 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-a5c20e07-7685-4402-ae4f-cf110618b671" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:05 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bf477f-438d-4d62-867b-53b2bf32028e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:05 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-0df9363b-1973-4430-8160-da4146c8405a" returned: 0 in 0.411s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-quobyte-0df9363b-1973-4430-8160-da4146c8405a" released by "delete_volume" :: held 0.858s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:05 devstack sudo[109281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671
Sep 12 21:15:05 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Created reservations ['5e6c24f6-20a6-4d2e-907b-fa29fc46e86a', '5ac544e7-273b-4513-81dd-ad1fae6cfec2', 'a8adb35f-f239-4314-819f-0043b9b41d84', '455b7d79-3f18-42e4-9425-8262c48b0028'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:05 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.416s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Deleted volume successfully.
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-cb6a362a-ca51-4397-8fb8-56c52bcb004d tempest-ProjectReaderTests-1598873464 None] Lock "cinder-06b7f4aa-3a19-4bea-bc44-e6263df86a6b-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:05 devstack sudo[109286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:05 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:05 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671" returned: 0 in 0.532s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:05 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671
Sep 12 21:15:05 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:05 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.371s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:05 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Deleted volume successfully.
Sep 12 21:15:05 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-422f5aae-d9c8-4315-b7c9-9fe73892148d tempest-SnapshotDependencyTests-1612716757 None] Lock "cinder-0df9363b-1973-4430-8160-da4146c8405a-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:06 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-a5c20e07-7685-4402-ae4f-cf110618b671" returned: 0 in 0.318s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-a5c20e07-7685-4402-ae4f-cf110618b671" released by "delete_volume" :: held 0.949s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Created reservations ['e173cede-90a4-4294-bd23-c2be25a73028', '295521c0-f579-4834-8460-ea1cec8cf703', '8161905c-3a38-4659-88aa-a767c5bd3eda', '554b5ac2-2bc1-4eb2-a195-35df829afb3f'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:06 devstack sudo[109295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:06 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:06 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.312s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:06 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:15:06 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-81d1b8ea-1482-4d2c-8dbe-4e5463e5aca6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-a5c20e07-7685-4402-ae4f-cf110618b671-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (b028f59a-b7ac-46aa-94b9-cfe7da4492df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f67d26-13fd-44a4-b802-21e608847efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f67d26-13fd-44a4-b802-21e608847efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489588725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557776d3-6ceb-4088-8df4-74279c4a50b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:08Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324f0faa-533a-42b8-92aa-872645bc0bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324f0faa-533a-42b8-92aa-872645bc0bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e633fbe-6f62-467d-a6e3-7648ffa7de08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e633fbe-6f62-467d-a6e3-7648ffa7de08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557776d3-6ceb-4088-8df4-74279c4a50b1', 'volume_name': 'volume-557776d3-6ceb-4088-8df4-74279c4a50b1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbccee9-b197-4b16-8859-f6ff43031a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbccee9-b197-4b16-8859-f6ff43031a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1cfefc-0ede-47d2-a01d-7091857d5262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:07 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Volume 557776d3-6ceb-4088-8df4-74279c4a50b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557776d3-6ceb-4088-8df4-74279c4a50b1', 'volume_size': 1}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489588725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557776d3-6ceb-4088-8df4-74279c4a50b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:08Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Creating volume 557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:15:07 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:15:07 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:07 devstack sudo[109300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 1073741824
Sep 12 21:15:07 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:08 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 1073741824" returned: 0 in 0.419s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:08 devstack sudo[109306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1
Sep 12 21:15:08 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:08 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1" returned: 0 in 0.284s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1cfefc-0ede-47d2-a01d-7091857d5262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557776d3-6ceb-4088-8df4-74279c4a50b1', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baeaa91-6482-44a3-8871-321692f782aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:08 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Volume volume-557776d3-6ceb-4088-8df4-74279c4a50b1 (557776d3-6ceb-4088-8df4-74279c4a50b1): created successfully
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baeaa91-6482-44a3-8871-321692f782aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (b028f59a-b7ac-46aa-94b9-cfe7da4492df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:08 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-ef9b1f0a-1181-4dec-9d86-525bca03b17f tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Creating offline snapshot 187bd3f9-74bb-4ef4-892f-6aa51d6657c5 of volume 557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc33ac42-32e7-48a1-9b9d-204f67a4f531]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:08 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:09 devstack sudo[109309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1
Sep 12 21:15:09 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:09 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1" returned: 0 in 0.372s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:09 devstack sudo[109315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 1G
Sep 12 21:15:09 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:09 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 1G" returned: 0 in 0.458s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:09 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557776d3-6ceb-4088-8df4-74279c4a50b1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:09 devstack sudo[109320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557776d3-6ceb-4088-8df4-74279c4a50b1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5
Sep 12 21:15:09 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:10 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557776d3-6ceb-4088-8df4-74279c4a50b1 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5" returned: 0 in 0.323s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:10 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 is being set with open permissions: ugo+rw
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:10 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5
Sep 12 21:15:10 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:10 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5" returned: 0 in 0.275s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=256,cinder:SELECT=199,cinder:DELETE=22,cinder:INSERT=74 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:10 devstack sudo[109329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info
Sep 12 21:15:10 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:10 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info" returned: 0 in 0.257s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:10 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info is being set with open permissions: ugo+rw
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:10 devstack sudo[109332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info
Sep 12 21:15:10 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:10 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.info" returned: 0 in 0.257s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:10 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:11 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-83c3e678-120a-4496-880f-ccbd17bad59d tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-187bd3f9-74bb-4ef4-892f-6aa51d6657c5-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Lock "cinder-187bd3f9-74bb-4ef4-892f-6aa51d6657c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-557776d3-6ceb-4088-8df4-74279c4a50b1" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-557776d3-6ceb-4088-8df4-74279c4a50b1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-187bd3f9-74bb-4ef4-892f-6aa51d6657c5" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-187bd3f9-74bb-4ef4-892f-6aa51d6657c5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot 187bd3f9-74bb-4ef4-892f-6aa51d6657c5 of volume 557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4eeb22-eb25-4ed3-b35c-3fd67de0cf76]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:12 devstack sudo[109337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5
Sep 12 21:15:12 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:12 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557776d3-6ceb-4088-8df4-74279c4a50b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe2c98-0acc-4413-929b-c1b580369c90]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:12 devstack sudo[109342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1
Sep 12 21:15:12 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:12 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1" returned: 0 in 0.354s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:12 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:13 devstack sudo[109347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5
Sep 12 21:15:13 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:13 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5" returned: 0 in 0.326s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:13 devstack sudo[109353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5
Sep 12 21:15:13 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:13 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1.187bd3f9-74bb-4ef4-892f-6aa51d6657c5" returned: 0 in 0.283s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-187bd3f9-74bb-4ef4-892f-6aa51d6657c5" released by "_delete_snapshot" :: held 1.460s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-557776d3-6ceb-4088-8df4-74279c4a50b1" released by "delete_snapshot" :: held 1.485s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Created reservations ['742542f2-a01d-439a-a9f6-a87bb5700176', 'c5d7d814-7f10-4bba-9eeb-6ccbc0f93ce0', '788dee2f-c962-41de-9ee3-4161b20b1ee4', 'd5439710-03f0-4282-b013-0ceb7040f97c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:13 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:15:13 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4d51611-1617-4b62-b471-7ed7517fdc85 tempest-ProjectMemberTests-792499713 None] Lock "cinder-187bd3f9-74bb-4ef4-892f-6aa51d6657c5-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-557776d3-6ceb-4088-8df4-74279c4a50b1-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Lock "cinder-557776d3-6ceb-4088-8df4-74279c4a50b1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-557776d3-6ceb-4088-8df4-74279c4a50b1" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-557776d3-6ceb-4088-8df4-74279c4a50b1" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[464cafe9-5caf-410d-b60b-8cd08a0b8090]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:14 devstack sudo[109357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1
Sep 12 21:15:14 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:14 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1" returned: 0 in 0.376s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:14 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:14 devstack sudo[109362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1
Sep 12 21:15:14 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:15 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-557776d3-6ceb-4088-8df4-74279c4a50b1" returned: 0 in 0.254s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-557776d3-6ceb-4088-8df4-74279c4a50b1" released by "delete_volume" :: held 0.707s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Created reservations ['e46d4d18-0b09-442c-a5dd-5dd9de3a38c9', '062a044e-ae7d-4f1b-b1a5-057ae300f289', 'beff77a4-f7c2-40a0-9544-c72b3f7a72cb', '416add65-df22-40cf-b78b-762123c0c32e'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:15 devstack sudo[109365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:15 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:15 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.271s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:15 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a0b1a285-4d4a-41de-8ffc-cc2f480eb761 tempest-ProjectMemberTests-792499713 None] Lock "cinder-557776d3-6ceb-4088-8df4-74279c4a50b1-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (866b99d0-bfc3-48ad-832d-f12c8f041213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:15 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3494c3d8-90e7-4a25-89e0-90bdebf704e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3494c3d8-90e7-4a25-89e0-90bdebf704e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438045328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abe66f0-4181-47d4-a05e-fbe2a4f0bf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:16Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109a0f1e-9cc0-4262-a467-a1de1303b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109a0f1e-9cc0-4262-a467-a1de1303b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1e5455-50f9-4838-9d15-7f0684e6b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1e5455-50f9-4838-9d15-7f0684e6b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abe66f0-4181-47d4-a05e-fbe2a4f0bf15', 'volume_name': 'volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a3794b-97b9-4e42-9cbd-28ceab56d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a3794b-97b9-4e42-9cbd-28ceab56d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998b1970-5ab4-4e13-8951-52eadb3685cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Volume 5abe66f0-4181-47d4-a05e-fbe2a4f0bf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15', 'volume_size': 1}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438045328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abe66f0-4181-47d4-a05e-fbe2a4f0bf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:16Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Creating volume 5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:15:16 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:16 devstack sudo[109368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 1073741824
Sep 12 21:15:16 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:16 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 1073741824" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:16 devstack sudo[109373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15
Sep 12 21:15:16 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:16 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" returned: 0 in 0.241s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998b1970-5ab4-4e13-8951-52eadb3685cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954f7f98-bc1e-4b7e-a494-cfb5481b9e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:16 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Volume volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 (5abe66f0-4181-47d4-a05e-fbe2a4f0bf15): created successfully
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954f7f98-bc1e-4b7e-a494-cfb5481b9e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:16 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (866b99d0-bfc3-48ad-832d-f12c8f041213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:16 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-819b53e7-6f39-4571-bfb8-9cc83a5103d8 tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Creating offline snapshot 172099d3-2f68-482c-b4d5-a7e7ee0a3e35 of volume 5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b37b88-ae1d-4e2e-a8ce-100306d73261]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:17 devstack sudo[109376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15
Sep 12 21:15:17 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:17 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" returned: 0 in 0.349s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:17 devstack sudo[109381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 1G
Sep 12 21:15:17 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:17 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 1G" returned: 0 in 0.380s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:17 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:17 devstack sudo[109386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35
Sep 12 21:15:17 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:18 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35" returned: 0 in 0.282s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:18 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 is being set with open permissions: ugo+rw
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:18 devstack sudo[109392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35
Sep 12 21:15:18 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:18 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35" returned: 0 in 0.235s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:18 devstack sudo[109395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info
Sep 12 21:15:18 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:18 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info" returned: 0 in 0.245s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:18 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info is being set with open permissions: ugo+rw
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:18 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info
Sep 12 21:15:18 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:18 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.info" returned: 0 in 0.236s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:18 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:18 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-d9d2a286-ea5c-49ff-90e5-4c8bcc1f7129 tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-172099d3-2f68-482c-b4d5-a7e7ee0a3e35-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Lock "cinder-172099d3-2f68-482c-b4d5-a7e7ee0a3e35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-172099d3-2f68-482c-b4d5-a7e7ee0a3e35" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-172099d3-2f68-482c-b4d5-a7e7ee0a3e35" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot 172099d3-2f68-482c-b4d5-a7e7ee0a3e35 of volume 5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c939d650-3d1a-4cd7-892c-09f1abc6609c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:19 devstack sudo[109401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35
Sep 12 21:15:19 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:19 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc97c98-2e12-4dbf-95ca-c26826b7e6f1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:19 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:19 devstack sudo[109406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15
Sep 12 21:15:19 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:20 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" returned: 0 in 0.356s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:20 devstack sudo[109417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35
Sep 12 21:15:20 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:20 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35" returned: 0 in 0.327s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:20 devstack sudo[109422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35
Sep 12 21:15:20 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:20 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15.172099d3-2f68-482c-b4d5-a7e7ee0a3e35" returned: 0 in 0.242s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-172099d3-2f68-482c-b4d5-a7e7ee0a3e35" released by "_delete_snapshot" :: held 1.359s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" released by "delete_snapshot" :: held 1.384s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Created reservations ['f7c4cf32-3309-410e-aca8-5dff444d7cdc', '6a081a79-860e-48c9-a1b8-00ca6be5395d', '86555476-078d-40e6-95ab-3e772b6ce9f6', '9e2b41d3-a112-4b80-854c-79bc3354d3e3'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:20 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:15:20 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-a89cde05-a38b-48ae-949a-894fb1abf900 tempest-ProjectMemberTests-792499713 None] Lock "cinder-172099d3-2f68-482c-b4d5-a7e7ee0a3e35-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Lock "cinder-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" acquired by "delete_volume" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d4370-19d0-4247-b269-8bd1f0050b81]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:21 devstack sudo[109425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15
Sep 12 21:15:21 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:21 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" returned: 0 in 0.342s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:21 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:21 devstack sudo[109430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15
Sep 12 21:15:21 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:22 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" returned: 0 in 0.250s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15" released by "delete_volume" :: held 0.644s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Created reservations ['139fc9dc-aa65-4044-8002-5bfc5bd411a4', '715eeb8e-a37e-4f94-9de3-cb9ff9ad666b', '4c9c3aac-12e0-4228-8199-ee1d2d1cc573', 'c52e61ec-0694-48aa-80c2-1d5d70128fe9'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:22 devstack sudo[109434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:22 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:22 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.238s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:22 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f6ff6d4d-a417-4ea4-b7a7-bfd19d353380 tempest-ProjectMemberTests-792499713 None] Lock "cinder-5abe66f0-4181-47d4-a05e-fbe2a4f0bf15-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (ee950fb7-2b19-4fa7-824f-d39e84bed8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97b39fc-5dfe-4c24-b6dc-e5d84ed73b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97b39fc-5dfe-4c24-b6dc-e5d84ed73b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617150046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0ba59f-4000-427e-b2aa-e73fa80580ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:23Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9180a548-ce5c-4a8f-9423-5a3ee6b96b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9180a548-ce5c-4a8f-9423-5a3ee6b96b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ccd5d9-9aa5-4bf9-906c-7d16e5cc9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ccd5d9-9aa5-4bf9-906c-7d16e5cc9292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0ba59f-4000-427e-b2aa-e73fa80580ce', 'volume_name': 'volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9dfb39-689a-43d4-b38a-ff9b2ae3cb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9dfb39-689a-43d4-b38a-ff9b2ae3cb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84bb7af-93ee-49ea-b632-57469cd921df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:22 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Volume ad0ba59f-4000-427e-b2aa-e73fa80580ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce', 'volume_size': 1}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617150046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0ba59f-4000-427e-b2aa-e73fa80580ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:23Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Creating volume ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:15:22 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:15:22 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:23 devstack sudo[109437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce 1073741824
Sep 12 21:15:23 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:23 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce 1073741824" returned: 0 in 0.390s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:23 devstack sudo[109442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce
Sep 12 21:15:23 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:23 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce" returned: 0 in 0.241s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84bb7af-93ee-49ea-b632-57469cd921df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05527cf-6b45-4c12-92ca-2c2f8d44718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:23 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Volume volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce (ad0ba59f-4000-427e-b2aa-e73fa80580ce): created successfully
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05527cf-6b45-4c12-92ca-2c2f8d44718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:23 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (ee950fb7-2b19-4fa7-824f-d39e84bed8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:23 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-107688e9-a14c-4ebb-be40-23d9720798a7 tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Creating offline snapshot 14cf6d7d-c37a-4ac5-945c-6cd0152968d4 of volume ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9b48c6-9d7f-4a12-923f-f057ff9be649]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:24 devstack sudo[109445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce
Sep 12 21:15:24 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:24 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce" returned: 0 in 0.364s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:24 devstack sudo[109450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 1G
Sep 12 21:15:24 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:24 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 1G" returned: 0 in 0.366s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:24 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:24 devstack sudo[109455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4
Sep 12 21:15:24 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:25 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4" returned: 0 in 0.286s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:25 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 is being set with open permissions: ugo+rw
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:25 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4
Sep 12 21:15:25 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:25 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4" returned: 0 in 0.236s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:25 devstack sudo[109463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info
Sep 12 21:15:25 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:25 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info" returned: 0 in 0.243s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:25 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info is being set with open permissions: ugo+rw
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:25 devstack sudo[109466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info
Sep 12 21:15:25 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:25 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.info" returned: 0 in 0.238s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:25 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:25 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-63c4198f-8da3-472b-9fff-e528423375ad tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-14cf6d7d-c37a-4ac5-945c-6cd0152968d4-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-14cf6d7d-c37a-4ac5-945c-6cd0152968d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-ad0ba59f-4000-427e-b2aa-e73fa80580ce" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-ad0ba59f-4000-427e-b2aa-e73fa80580ce" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-14cf6d7d-c37a-4ac5-945c-6cd0152968d4" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-14cf6d7d-c37a-4ac5-945c-6cd0152968d4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot 14cf6d7d-c37a-4ac5-945c-6cd0152968d4 of volume ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf7e33-410e-4d83-a521-0b0f0c64cf18]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:26 devstack sudo[109469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4
Sep 12 21:15:26 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:26 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e15c82-3551-4485-9314-65ad0aa9eec5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:26 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce
Sep 12 21:15:26 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:26 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce" returned: 0 in 0.348s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:26 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:27 devstack sudo[109479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4
Sep 12 21:15:27 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:27 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4" returned: 0 in 0.319s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:27 devstack sudo[109484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4
Sep 12 21:15:27 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:27 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce.14cf6d7d-c37a-4ac5-945c-6cd0152968d4" returned: 0 in 0.246s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-14cf6d7d-c37a-4ac5-945c-6cd0152968d4" released by "_delete_snapshot" :: held 1.346s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-ad0ba59f-4000-427e-b2aa-e73fa80580ce" released by "delete_snapshot" :: held 1.368s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Created reservations ['8ef9e882-5cba-40a3-b396-14c189670bbc', '9c125252-a8d3-4da8-93fa-6e579965e12b', '1f214fa6-bdc1-42f1-a29c-22f044633b81', '12ac17c8-d9ec-456f-817e-be269817162c'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:27 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:15:27 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-4225223c-2f1e-4f73-80af-aaa6e582a0b6 tempest-ProjectMemberTests-792499713 None] Lock "cinder-14cf6d7d-c37a-4ac5-945c-6cd0152968d4-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-ad0ba59f-4000-427e-b2aa-e73fa80580ce-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Lock "cinder-ad0ba59f-4000-427e-b2aa-e73fa80580ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-ad0ba59f-4000-427e-b2aa-e73fa80580ce" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-ad0ba59f-4000-427e-b2aa-e73fa80580ce" acquired by "delete_volume" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b344ee4-77ef-491b-a41f-74a7403c39b6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:28 devstack sudo[109487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce
Sep 12 21:15:28 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:28 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce" returned: 0 in 0.350s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:28 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:28 devstack sudo[109492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce
Sep 12 21:15:28 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:29 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-ad0ba59f-4000-427e-b2aa-e73fa80580ce" returned: 0 in 0.249s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-ad0ba59f-4000-427e-b2aa-e73fa80580ce" released by "delete_volume" :: held 0.650s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Created reservations ['f7bfbf7c-de47-448c-9b1f-fb39a680e650', '8c9f9f98-712c-4b9c-a2c3-d661ae49f9ee', '2cb43dd1-478b-413c-a0e1-252cf1ad908c', 'c239f97f-dbd2-4901-a3b7-1d096384a460'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:29 devstack sudo[109495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:29 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:29 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.241s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:29 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-f4c4d0d1-49a6-401f-8ae9-a888f1c04e7b tempest-ProjectMemberTests-792499713 None] Lock "cinder-ad0ba59f-4000-427e-b2aa-e73fa80580ce-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.flows.manager.create_volume [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (94a75d32-1e4b-4014-88f2-5ed47974fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c63afd-7a66-4e6b-b2bb-a5b3bb30210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c63afd-7a66-4e6b-b2bb-a5b3bb30210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615142302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e6981-725f-4e19-a7d6-dd5494ed2d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:30Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca36c35-ddb1-4ac4-83a8-75dcc00653e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca36c35-ddb1-4ac4-83a8-75dcc00653e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d151f8fc-d44c-402e-9802-714871e135d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d151f8fc-d44c-402e-9802-714871e135d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92e6981-725f-4e19-a7d6-dd5494ed2d7e', 'volume_name': 'volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35db7ed4-3122-4c82-b0e7-d0f25ff736df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35db7ed4-3122-4c82-b0e7-d0f25ff736df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5574a3fa-69a1-48a3-9f4d-bdd29fbac8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:29 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Volume e92e6981-725f-4e19-a7d6-dd5494ed2d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e', 'volume_size': 1}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d5057b81130>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-12T19:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615142302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e6981-725f-4e19-a7d6-dd5494ed2d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0afc66e4b144cc3a0e67045c3f394e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-12T19:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-12T19:15:30Z,use_quota=True,user_id='d242fa9b205a4d1884a633dec137e000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b22281-2ada-418b-9a89-2707913cb456),volume_type_id=03b22281-2ada-418b-9a89-2707913cb456)}" {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Creating volume e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Selected osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44 as target Quobyte volume. {{(pid=87624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Sep 12 21:15:29 devstack cinder-volume[87624]: INFO cinder.volume.drivers.remotefs [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] casted to osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44
Sep 12 21:15:29 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e 1073741824 {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:29 devstack sudo[109498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e 1073741824
Sep 12 21:15:29 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:30 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e 1073741824" returned: 0 in 0.401s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:30 devstack sudo[109503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e
Sep 12 21:15:30 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:30 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" returned: 0 in 0.239s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'} {{(pid=87624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5574a3fa-69a1-48a3-9f4d-bdd29fbac8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e', 'volume_size': 1}' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef5925f-d737-4039-a2f9-f7327d6b0e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 12 21:15:30 devstack cinder-volume[87624]: INFO cinder.volume.flows.manager.create_volume [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Volume volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e (e92e6981-725f-4e19-a7d6-dd5494ed2d7e): created successfully
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef5925f-d737-4039-a2f9-f7327d6b0e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87624) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 12 21:15:30 devstack cinder-volume[87624]: DEBUG cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Flow 'volume_create_manager' (94a75d32-1e4b-4014-88f2-5ed47974fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87624) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 12 21:15:30 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-da92fc08-1c29-4d50-b326-31593d200df6 tempest-ProjectMemberTests-792499713 None] Created volume successfully.
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Creating offline snapshot d2c7e78a-3843-4ba3-822d-895b7d239baa of volume e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eafcdaa-15b2-4517-80d9-d4faced6d6ff]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:31 devstack sudo[109506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e
Sep 12 21:15:31 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:31 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" returned: 0 in 0.352s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa 1G {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:31 devstack sudo[109511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa 1G
Sep 12 21:15:31 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:31 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa 1G" returned: 0 in 0.370s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:31 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:31 devstack sudo[109517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa
Sep 12 21:15:31 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:32 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e -F qcow2 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa" returned: 0 in 0.288s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:32 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa is being set with open permissions: ugo+rw
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:32 devstack sudo[109523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa
Sep 12 21:15:32 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:32 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa" returned: 0 in 0.240s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:32 devstack sudo[109526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info
Sep 12 21:15:32 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:32 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info" returned: 0 in 0.244s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:32 devstack cinder-volume[87624]: WARNING cinder.volume.drivers.remotefs [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info is being set with open permissions: ugo+rw
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:32 devstack sudo[109530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info
Sep 12 21:15:32 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:32 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.info" returned: 0 in 0.234s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:32 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:32 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-283d8dc3-cccd-4a54-bc80-f84ceab27510 tempest-ProjectMemberTests-792499713 None] Create snapshot completed successfully
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-d2c7e78a-3843-4ba3-822d-895b7d239baa-delete_snapshot" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Lock "cinder-d2c7e78a-3843-4ba3-822d-895b7d239baa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" by "delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-d2c7e78a-3843-4ba3-822d-895b7d239baa" by "_delete_snapshot" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-d2c7e78a-3843-4ba3-822d-895b7d239baa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Deleting offline snapshot d2c7e78a-3843-4ba3-822d-895b7d239baa of volume e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] snapshot_file for this snap is: volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa {{(pid=87624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c1448-3312-4a54-8e27-86eb3c9adafc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_service.periodic_task [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:33 devstack sudo[109534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:33 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:33 devstack sudo[109533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa
Sep 12 21:15:33 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:33 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.246s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-884342f0-9900-4f09-89c5-b53ed7a904d9 None None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:33 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa" returned: 0 in 0.357s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.remotefs [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4547e7-3d63-4615-a1c4-b4b05f1c64d1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:33 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:33 devstack sudo[109541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e
Sep 12 21:15:33 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:34 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" returned: 0 in 0.344s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:34 devstack sudo[109546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa
Sep 12 21:15:34 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:34 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa" returned: 0 in 0.332s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:34 devstack sudo[109551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa
Sep 12 21:15:34 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:34 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e.d2c7e78a-3843-4ba3-822d-895b7d239baa" returned: 0 in 0.245s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-d2c7e78a-3843-4ba3-822d-895b7d239baa" released by "_delete_snapshot" :: held 1.368s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" released by "delete_snapshot" :: held 1.389s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Created reservations ['890866d0-847a-42f6-8c3b-9d9e4e072345', 'b3f09840-951c-4f49-a19a-5aa8a1f7ac67', '6ae0de3e-b1d6-415f-82d0-2305c71c518e', '7a5f6845-6abb-4149-8821-4467e1ecad38'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:34 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Delete snapshot completed successfully.
Sep 12 21:15:34 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-677e5e5e-dce8-4b4b-b2d2-74eea2ad2470 tempest-ProjectMemberTests-792499713 None] Lock "cinder-d2c7e78a-3843-4ba3-822d-895b7d239baa-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-e92e6981-725f-4e19-a7d6-dd5494ed2d7e-delete_volume" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Lock "cinder-e92e6981-725f-4e19-a7d6-dd5494ed2d7e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Acquiring lock "cinder-quobyte-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" by "delete_volume" {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" acquired by "delete_volume" :: waited 0.015s {{(pid=87624) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0a5cb-e9e5-463f-a0b6-f12b988e8342]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:35 devstack sudo[109554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e
Sep 12 21:15:35 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:35 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" returned: 0 in 0.348s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:35 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:35 devstack sudo[109559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e
Sep 12 21:15:35 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:36 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf/volume-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" returned: 0 in 0.236s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Lock "cinder-quobyte-e92e6981-725f-4e19-a7d6-dd5494ed2d7e" released by "delete_volume" :: held 0.638s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG cinder.quota [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Created reservations ['d50e9678-98c5-4371-b5f1-63abd6a24dae', 'b6dd3a7f-a42c-42b9-8339-68b11d5ecab4', 'a3c0eced-0cab-4df4-94aa-1de53068aa4a', '65ff11c7-15fe-4581-a315-3950503f6399'] {{(pid=87624) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44': None} {{(pid=87624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG cinder.volume.drivers.quobyte [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b152204d-e1ec-4710-8ba1-fd3d478d1c44'] {{(pid=87624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.lockutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87624) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 12 21:15:36 devstack sudo[109562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf
Sep 12 21:15:36 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 12 21:15:36 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG oslo_concurrency.processutils [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae2f719bfe5a2552e19a7157cab7ecbf" returned: 0 in 0.242s {{(pid=87624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG cinder.manager [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Notifying Schedulers of capabilities ... {{(pid=87624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 12 21:15:36 devstack cinder-volume[87624]: INFO cinder.volume.manager [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Deleted volume successfully.
Sep 12 21:15:36 devstack cinder-volume[87624]: DEBUG cinder.coordination [None req-bf6b76e4-dfb3-4090-85f5-be9c58d50e30 tempest-ProjectMemberTests-792499713 None] Lock "cinder-e92e6981-725f-4e19-a7d6-dd5494ed2d7e-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87624) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 12 21:15:46 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:UPDATE=126,cinder:SELECT=82,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 12 21:15:46 devstack cinder-volume[87624]: DEBUG dbcounter [-] [87624] Writing DB stats cinder:SELECT=54,cinder:INSERT=23,cinder:UPDATE=64,cinder:DELETE=8 {{(pid=87624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}